-- Logs begin at Wed 2022-08-31 03:26:41 UTC, end at Wed 2022-08-31 04:29:06 UTC. -- Aug 31 03:58:01.320720 dv-cinder-853910-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 03:58:01.329746 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 03:58:01 2022] *** Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: nodename: dv-cinder-853910-5-iscsi Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: machine: x86_64 Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: clock source: unix Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: pcre jit disabled Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: detected number of CPU cores: 4 Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: current working directory: / Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: detected binary path: /usr/bin/uwsgi-core Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: your processes number limit is 47680 Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: your memory page size is 4096 bytes Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: detected max file descriptor number: 2048 Aug 31 03:58:01.331911 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: lock engine: pthread robust mutexes Aug 31 03:58:01.333172 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: thunder lock: enabled Aug 31 03:58:01.333172 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 03:58:01.333172 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 03:58:01.371259 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: Python main interpreter initialized at 0x5577bba6a9c0 Aug 31 03:58:01.371259 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: python threads support enabled Aug 31 03:58:01.371259 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: your server socket listen backlog is limited to 100 connections Aug 31 03:58:01.371259 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: your mercy for graceful operations on workers is 90 seconds Aug 31 03:58:01.371612 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 03:58:01.371612 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: *** Operational MODE: preforking *** Aug 31 03:58:01.371908 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: *** uWSGI is running in multiple interpreter mode *** Aug 31 03:58:01.371908 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: spawned uWSGI master process (pid: 105673) Aug 31 03:58:01.372097 dv-cinder-853910-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 03:58:01.372617 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: spawned uWSGI worker 1 (pid: 105674, cores: 1) Aug 31 03:58:01.372950 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: spawned uWSGI worker 2 (pid: 105675, cores: 1) Aug 31 03:58:01.373111 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 03:58:02.022943 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 03:58:02.039068 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 03:58:03.093148 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 03:58:03.093148 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: from cryptography.utils import int_from_bytes Aug 31 03:58:03.093780 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 03:58:03.093780 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: from cryptography.utils import int_from_bytes Aug 31 03:58:03.102146 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 03:58:03.102146 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: from cryptography.utils import int_from_bytes Aug 31 03:58:03.102605 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 03:58:03.102605 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: from cryptography.utils import int_from_bytes Aug 31 03:58:05.585715 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 03:58:05.586366 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 03:58:05.586366 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 03:58:05.586708 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 03:58:05.586861 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 03:58:05.587276 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 03:58:05.587372 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 03:58:05.587452 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.587541 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 03:58:05.587625 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.587869 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 03:58:05.588010 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.588097 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 03:58:05.588249 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.588461 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.588573 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.588792 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.588900 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.589095 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.589191 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.589422 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.589530 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.589746 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.589847 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.590006 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.590104 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.590312 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.590411 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.590629 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-5-iscsi {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.590721 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.590940 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.591070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.591243 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.591333 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.591548 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.591638 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.591860 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.591961 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-5-iscsi {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.592142 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.592229 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.592467 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.592610 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.592749 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.592867 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.593058 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.593234 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.593353 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.594402 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.594598 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.594598 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.594733 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.594801 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.594873 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.594960 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.595067 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.595139 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.595219 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.595296 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.595369 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.595529 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.595743 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.595873 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.596004 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.596134 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.596265 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.596393 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.596562 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.596894 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-5-iscsi {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.597043 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.597182 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.597307 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.597463 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.597607 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.597767 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.597927 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-5-iscsi {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.598179 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.598317 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.598474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.598606 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.598772 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.598914 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.599112 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.599278 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.599421 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.599545 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.599700 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.599811 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.600020 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.600150 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.600332 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.600427 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.600643 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.600745 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.600957 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.601065 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.601253 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.601348 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.601553 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.601647 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.601854 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.601958 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.602159 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.602251 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.602454 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.602546 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.602752 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.602858 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.602997 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.603130 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.603313 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.603399 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.603627 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.603714 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.603889 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.603973 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.604189 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.604275 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.604471 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.604556 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.604716 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.604805 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.605046 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.605145 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.605341 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.605431 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.605640 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.605726 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.605940 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.606026 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.606236 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.606320 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.606535 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.606619 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.606833 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.606919 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.607174 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.607267 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.607463 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.607559 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.607760 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.607846 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.608068 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.608152 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.608370 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.608454 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.608670 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.608763 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.608968 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.609058 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.609283 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.609377 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.609613 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.609705 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.609902 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.609993 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.610201 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.610297 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.610534 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.610618 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.610836 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.610920 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.611160 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.611277 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.611484 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.611571 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.611799 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.611891 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.612100 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.612195 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.612426 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.612522 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.612724 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.612809 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.613035 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.613121 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.613335 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.613418 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.613641 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.613734 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.613884 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.613968 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.614179 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.614263 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.614475 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.614561 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.614787 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.614873 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.615109 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.615195 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.615745 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.615835 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.616046 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.616133 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.616344 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.616436 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.616644 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.616750 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.616947 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.617033 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.617243 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.617336 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.617542 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.617648 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.617849 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.617941 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.618143 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.618227 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.618442 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.618536 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.618738 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.618835 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.619045 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.619132 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.619359 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.619529 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.619660 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.619741 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.619958 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.620050 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.620257 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.620351 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.620555 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.620640 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.620855 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.620941 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.621156 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.621248 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.621452 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.621542 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.621749 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.621834 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.622061 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.622154 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.622360 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.622451 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.622658 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.622741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.622969 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.623084 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.623297 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.623382 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.623595 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.623688 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.623904 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.624055 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.624200 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.624294 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.624497 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.624583 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.624804 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.624891 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.625102 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.625193 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.625405 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.625489 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.625699 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.625785 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.625993 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.626103 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.626290 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.626375 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.626587 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.626671 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.626892 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.626979 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.627206 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.627293 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.627499 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.627585 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.627807 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.627900 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.628195 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.628300 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.628496 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.628678 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.628814 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.628989 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.629134 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.629293 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.629441 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.629608 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.629746 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.629938 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.630034 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.630263 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.630350 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:58:05.630600 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.630684 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.630924 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.631010 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.631275 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.631372 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.631601 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.631721 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.631914 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.632008 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.632223 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.632307 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.632532 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.632616 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.632851 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.632945 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.633159 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.633254 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.633463 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.633548 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.633768 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.633861 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.634080 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.634191 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.634389 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.634481 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.634703 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.634814 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.635011 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.635134 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.635345 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.635441 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.635657 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.635753 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.635963 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.636050 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.636273 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.636358 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.636583 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.636668 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.636898 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.636990 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.637203 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.637289 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.637529 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.637621 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.637839 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.637924 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.638160 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.638252 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.638479 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.638573 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.638793 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.638880 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.639121 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.639208 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.639428 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.639515 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.639730 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.639814 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.640039 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.640206 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.640347 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.640440 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.640651 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.640734 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.640964 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.641062 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.641267 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.641352 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.641583 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.641667 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.641887 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.641979 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.642190 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.642275 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.642491 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.642576 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.642796 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.642892 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.643120 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.643206 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.643428 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.643512 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.643795 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.643943 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.644126 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.644274 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.644443 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.644724 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.644819 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.645065 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.645153 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.645376 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.645451 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.645694 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.645788 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.646014 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.646099 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.646317 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.646411 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.646619 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.646713 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.646920 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.647004 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.647243 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.647319 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.647545 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.647632 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.647842 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.647915 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.648146 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.648218 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.648463 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.648538 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.648763 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.648852 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.649078 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.649152 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.649375 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.649449 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.649678 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.649752 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.649980 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.650062 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.650281 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.650357 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.650580 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.650665 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.650881 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.650963 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.651204 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.651280 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.651502 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.651582 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.651804 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.651895 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.652106 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.652180 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.652403 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.652484 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.652714 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.652797 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.653009 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.653139 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.653312 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.653409 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.653618 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.653716 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.653919 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.654175 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.654261 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.654513 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.654731 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.654828 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.655147 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.655303 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.655456 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.655759 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.655859 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.656088 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.656365 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.656458 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.656695 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.656935 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.657030 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.657317 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.657490 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.657628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.657926 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.658041 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.658227 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.658522 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.658613 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.658939 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.659141 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.659328 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.659420 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.659663 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.659800 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.659991 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.660128 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.660311 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.660477 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.660618 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.660780 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.660928 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.661081 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.661232 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.661380 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.661539 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.661701 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.661844 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.662005 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.662153 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.662302 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.662459 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.662601 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.662765 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.662898 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.663090 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.663265 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.663385 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.663566 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.663688 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.663904 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.663999 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.664238 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.664332 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.664553 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.664649 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.664869 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.664964 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.665174 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.665258 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.665479 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.665563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.665785 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.665873 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.666091 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.666177 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.666396 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.666489 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.666702 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.666788 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.667031 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.667118 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.667348 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.667444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.667663 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.667756 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.667968 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.668054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.668289 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.668383 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.668596 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.668687 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.668906 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.668991 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.669203 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.669296 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.669512 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.669598 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.669826 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.669910 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.670138 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.670306 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.670457 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.670549 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.670764 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.670847 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.671086 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.671190 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.671395 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.671480 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.671697 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.671788 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.671998 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.672093 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.672300 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.672387 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.672602 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.672695 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.672912 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.673000 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.673213 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.673344 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.673523 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.673609 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.673825 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.673912 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.674128 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.674212 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.674428 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.674557 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.674733 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.674851 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.675081 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.675217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.675389 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.675480 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.675700 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.675792 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.676015 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.676102 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.676314 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.676408 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.676619 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.676705 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.676932 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.677016 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.677237 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.677331 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.677538 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.677623 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.677843 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.677931 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.678142 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.678237 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.678441 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.678527 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.678743 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.678828 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.679070 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.679177 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.679375 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.679463 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.679677 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.679772 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.679976 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.680062 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.680276 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.680360 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.680574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.680658 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.680870 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.680957 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.681167 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.681253 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.681468 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.681552 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.681772 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.681867 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.682072 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.682156 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.682379 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.682472 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.682686 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.682773 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.682983 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.683082 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.683306 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.683451 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.683614 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.683709 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.683914 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.683998 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.684210 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.684305 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.684507 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.684593 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.684802 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.684888 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.685125 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.685222 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.685427 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.685513 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.685722 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.685807 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.686031 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.686125 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.686334 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.686418 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.686634 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.686725 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.686934 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.687020 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.687270 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.687354 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.687575 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.687660 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.687883 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.687968 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.688186 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.688278 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.688490 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.688583 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.688795 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.688881 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.689108 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.689193 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.689418 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.689512 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.689727 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.689813 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.690049 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.690134 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.690362 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.691557 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.691557 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.691782 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.691875 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.691951 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692019 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692105 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692186 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692271 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692359 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692596 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692725 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.692813 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.693035 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.693122 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.693344 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.693438 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.693651 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.693745 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.693960 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.694044 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.694275 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.694371 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.694651 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.694846 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.694959 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.695211 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.695299 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.695524 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.695630 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.695848 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.695934 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.696166 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.696259 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.696503 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.696589 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.696803 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.696945 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.697110 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.697196 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.697410 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.697504 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.697713 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.697799 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.698026 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.698112 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.698330 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.698424 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.698633 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.698756 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.698940 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.699221 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.699320 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.699558 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.699693 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.699860 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.700018 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.700167 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.700327 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.700473 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.700630 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.700776 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.700978 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.701070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.701367 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.701460 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.701679 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.701838 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.701979 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.702227 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.702321 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.702528 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.702613 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.702868 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.702961 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.703194 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.703295 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.703502 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.703680 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.703798 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.704089 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.704172 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.704429 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.704566 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.704734 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.704874 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.705073 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.705169 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.705399 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.705498 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.705743 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.705896 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.706054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.706367 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.706700 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.706793 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.707067 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.707197 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.707391 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.707494 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.707693 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.707784 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.707998 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.708082 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.708304 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.708403 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.708610 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.708695 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.708910 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.708995 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.709206 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.709298 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.709509 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.709602 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.709809 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.709894 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.710112 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.710205 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.710412 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.710499 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.710707 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.710791 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.711004 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.711150 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.711327 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.711415 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.711630 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.711723 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.711928 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.712021 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.712228 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.712323 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.712524 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.712618 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.712826 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.712917 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.713126 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.713219 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.713427 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.713526 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.713728 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.713813 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.714030 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.714166 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.714332 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.714425 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.714629 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.714720 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.714929 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.715070 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.715260 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.715358 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.715560 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.715652 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.715859 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.715943 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.716159 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.716245 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.716460 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.716544 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.716758 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.716844 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.717062 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.717148 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.717369 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.717455 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.717674 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.717760 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.717970 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.718055 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.718273 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.718359 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.718569 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.718655 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.718867 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.718956 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.719188 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.719275 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.719493 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.719595 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.719791 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.719885 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.720090 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.720176 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.720386 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.720481 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.720684 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.720778 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.720984 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.721070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.721282 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.721374 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.721585 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.721721 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.722039 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.722128 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.722349 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.722602 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.722692 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.722772 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.722972 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.723136 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.723320 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.723449 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.723644 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.723758 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.723948 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.724061 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.724257 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.724405 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.724568 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.724712 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.724872 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.725076 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.725174 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.725387 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.725473 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.725702 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.725788 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.726021 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.726118 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.726333 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.726419 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.726635 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.726720 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.726939 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.727045 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.727260 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.727346 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.727574 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.727659 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.727876 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.727971 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.728181 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.728268 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.728482 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.728606 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.728783 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.728872 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.729103 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.729194 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.729402 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.729495 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.729705 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.729791 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.730007 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.730101 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.730310 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.730395 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.730615 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.730701 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.730916 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.731002 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.731246 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.731342 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.731548 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.731642 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.731852 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.731938 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.732151 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.732243 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.732455 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.732540 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.732754 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.732848 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.733056 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.733151 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.733356 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.733448 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.733654 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.733740 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.733959 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.734051 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.734261 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.734352 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.734559 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.734644 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.734860 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.734947 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.735178 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.735277 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.735481 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.735575 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.735780 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.735866 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.736087 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.736207 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.736392 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.736514 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.736695 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.736826 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.736999 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.737124 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.737322 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.737451 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.737753 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.737837 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.738061 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.738145 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.738367 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.738469 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.738666 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.738803 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.738972 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.739115 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.739304 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.739404 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.739620 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.739705 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.739931 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.740024 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.740233 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.740643 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.740849 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.740973 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.741151 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.741282 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.741471 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.741588 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.741772 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.741896 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.742074 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.742204 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.742372 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.742484 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.742687 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.742793 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.742985 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.743138 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.743323 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.743441 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.743730 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.743824 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.744032 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.744116 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.744328 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.744413 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.744642 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.744726 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.744962 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.745060 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.745319 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.745403 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.745637 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.745722 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.745956 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.746053 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.746273 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.746359 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.746572 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.746668 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.746885 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.746971 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.747211 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.747310 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.747530 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.747619 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.747849 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.747934 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.748151 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.748245 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.748457 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.748543 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.748754 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.748883 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.749072 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.749168 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.749387 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.749473 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.749692 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.749777 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.750002 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.750098 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.750304 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.750389 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.750628 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.750715 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.750950 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.751066 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.751287 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.751385 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.751609 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.751695 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.751912 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.752019 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.752215 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.752340 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.752517 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.752645 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.752815 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.753037 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.753162 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.753381 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.753467 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.753687 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.753773 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.753990 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.754078 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.754300 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.754420 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.754600 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.754703 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.754906 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.754993 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.755255 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.755345 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.755561 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.755655 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.755875 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.755961 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.756184 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.756270 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.756489 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.756575 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.756787 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.756874 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.757089 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.757175 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.757394 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.757480 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.757695 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.757778 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.758001 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.758094 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.758299 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.758390 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.758598 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.758698 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.758898 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.758992 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.759239 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.759326 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.759542 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.759626 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.759855 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.759961 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.760154 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.760239 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.760459 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.760574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.760760 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.760864 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.761090 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.761175 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.761391 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.761486 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.761709 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.761797 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.762019 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.762112 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.762339 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.762433 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.762640 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.762779 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.762937 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.763052 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.763264 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.763362 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.763559 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.763647 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.763857 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.763943 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.764154 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.764284 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.764455 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.764542 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.764750 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.764837 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.765046 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.765141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.765342 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.765429 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.765656 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.765741 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.765953 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.766050 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.766255 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.766340 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.766555 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.766649 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.766856 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.766949 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.767177 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.767268 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.767474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.767560 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.767786 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.767872 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.768094 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.768178 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.768399 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.768490 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.768745 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.768835 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.769053 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.769138 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.769353 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.769450 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.769676 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.769762 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.769981 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.770065 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.770286 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.770371 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.770594 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.770681 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.770904 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.770991 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.771236 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.771341 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.771540 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.771626 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.771850 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.771936 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.772152 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.772243 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.772460 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.772546 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.772774 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.772975 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.773088 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.773303 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.773390 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.773613 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.773700 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.773919 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.774013 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.774223 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.774318 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.774530 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.774804 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.774894 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.775151 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.775244 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.775455 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.775546 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.775762 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.775855 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.776066 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.776162 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.776376 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.776474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.776686 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.776780 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.776997 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.777086 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.777307 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.777393 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.777618 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.777713 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.777928 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.778022 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.778235 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.778328 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.778545 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.778640 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.778882 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.778967 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.779216 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.779302 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.779521 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.779609 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.779831 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.779926 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.780143 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.780230 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.780450 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.780544 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.780754 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.780848 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.781059 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.781153 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.781368 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.781456 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.781675 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.781769 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.781978 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.782074 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.782280 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.782375 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.782586 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.782672 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.782889 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.782982 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.783226 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.783312 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.783539 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.783625 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.783848 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.783947 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.784156 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.784301 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.784511 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.784604 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.784824 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.784910 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.785334 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.785428 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.785648 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.785742 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.785977 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.786071 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.786298 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.786385 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.786620 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.786706 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.786936 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.787042 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.787274 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.787480 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.787598 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.787797 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.787884 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.788132 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.788218 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.788461 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.788554 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.788769 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.788855 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.789069 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.789157 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.789385 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.789472 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.789690 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.789779 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.789991 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.790077 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.790296 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.790379 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.790595 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.790689 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.790901 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.791140 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.791230 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.791485 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.791573 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.791796 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.791882 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.792118 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.792204 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.792433 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.792520 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.792743 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.792828 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.793045 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.793272 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.793367 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.793621 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.793707 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.793937 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.794032 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.794246 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.794340 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.794554 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.794640 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.794855 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.794941 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.795178 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.795278 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.795485 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.795580 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.795788 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.795874 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.796089 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.796177 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.796395 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.796481 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.796699 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.796784 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.797003 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.797095 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.797309 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.797395 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.797612 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.797698 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.797915 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.798009 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.798218 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.798304 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.798514 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.798611 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.798814 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.798900 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.799141 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.799231 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.799443 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.799540 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.799748 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.799866 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.800172 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.800265 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.800479 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.800577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.800782 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.800868 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.801088 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.801173 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.801388 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.801482 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.801692 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.801776 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.802002 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.802088 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.802309 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.802396 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.802618 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.802703 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.802920 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.803005 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.803253 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.803342 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.803556 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.803640 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.803864 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.803956 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.804165 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.804251 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.804468 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.804563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.804807 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.804893 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.805109 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.805197 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.805439 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.805629 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.805724 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.805956 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.806044 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.806270 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.806355 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.806594 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.806681 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.806927 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.807014 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.807254 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.807340 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.807557 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.807858 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.807953 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.808177 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.808263 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.808484 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.808578 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.808789 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.808889 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.809094 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.809187 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.809403 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.809525 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.809706 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.809794 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.810009 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.810094 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.810315 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.810401 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.810619 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.810708 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.810921 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.811008 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.811246 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.811334 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.811552 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.811640 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.811854 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.811940 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.812158 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.812252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.812458 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.812543 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.812764 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.812849 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.813072 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.813166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.813380 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.813467 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.813687 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.813773 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.813993 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.814087 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.814296 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.814381 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.814596 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.814688 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.814902 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.814999 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.815227 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.815315 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.815589 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.815684 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.815898 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.815986 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.816226 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.816360 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.816539 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.816679 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.816849 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.816978 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.817157 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.817387 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.817472 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.817691 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.817792 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.818006 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.818094 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.818318 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.818405 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.818621 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.818708 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.818939 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.819042 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.819280 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.819392 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.819584 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.819705 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.819897 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.820021 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.820201 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.820342 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.820522 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.820650 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.820854 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.820970 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.821175 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.821291 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.821495 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.821582 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.821793 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.821906 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.822091 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.822217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.822387 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.822547 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.822687 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.822886 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.822997 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.823239 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.823370 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.823564 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.823658 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.823869 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.823964 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.824170 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.824263 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.824466 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.824553 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.824762 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.824857 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.825060 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.825146 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.825357 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.825443 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.825656 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.825750 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.825950 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.826043 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.826244 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.826338 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.826540 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.826636 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.826840 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.826931 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.827160 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.827259 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.827457 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.827545 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.827756 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.827852 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.828050 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.828136 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.828348 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.828434 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.828642 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.828729 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.828935 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.829020 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.829227 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.829321 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.829526 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.829612 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.829832 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.829927 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.830133 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.830219 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.830434 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.830520 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.830733 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.830828 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.831122 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.831273 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.831405 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.831535 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.831739 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.831960 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.832072 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.832287 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.832373 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.832601 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.832686 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.832904 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.832991 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.833232 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.833318 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.833537 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.833635 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.833843 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.833929 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.834147 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.834233 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.834450 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.834612 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.834756 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.834844 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.835084 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.835193 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.835407 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.835506 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.835776 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.835871 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.836027 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.836113 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.836333 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.836432 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.836646 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.836731 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.836952 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.837037 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.837262 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.837349 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.837569 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.837655 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.837872 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.837957 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.838184 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.838270 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.838489 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.838577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.838793 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.838887 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.839124 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.839227 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.839431 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.839525 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.839740 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.839878 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.840044 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.840132 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.840348 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.840432 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.840654 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.840748 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.840959 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.841044 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.841266 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.841362 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.841581 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.841676 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.841884 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.841969 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.842188 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.842273 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.842503 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.842589 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.842816 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.842908 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.843155 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.843255 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.843480 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.843569 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.843787 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.843873 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.844101 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.844185 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.844406 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.844493 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.844706 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.844791 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.844944 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 03:58:05.845039 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.845376 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.845711 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.846026 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.846355 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.846637 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:58:05.846925 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 03:58:06.000680 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO dbcounter [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Registered counter for database nova_api Aug 31 03:58:06.003590 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO dbcounter [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Registered counter for database nova_api Aug 31 03:58:06.022678 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_db.sqlalchemy.engines [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:58:06.024624 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_db.sqlalchemy.engines [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:58:06.029997 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writer thread running {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:58:06.031719 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writer thread running {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:58:06.086632 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.context [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d(cell1) {{(pid=105675) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 03:58:06.088699 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.context [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d(cell1) {{(pid=105674) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 03:58:06.090444 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_concurrency.lockutils [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 03:58:06.090915 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_concurrency.lockutils [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 03:58:06.092537 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_concurrency.lockutils [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 03:58:06.092666 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 03:58:06.093102 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 03:58:06.093240 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_concurrency.lockutils [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 03:58:06.093667 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_concurrency.lockutils [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 03:58:06.094667 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 03:58:06.095427 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 03:58:06.095668 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_concurrency.lockutils [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 03:58:06.095847 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 03:58:06.097924 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 03:58:06.098066 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO dbcounter [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Registered counter for database nova_cell0 Aug 31 03:58:06.099934 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO dbcounter [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Registered counter for database nova_cell0 Aug 31 03:58:06.103404 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO dbcounter [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Registered counter for database nova_cell1 Aug 31 03:58:06.104071 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO dbcounter [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Registered counter for database nova_cell1 Aug 31 03:58:06.111220 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_db.sqlalchemy.engines [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:58:06.113044 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_db.sqlalchemy.engines [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:58:06.114916 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_db.sqlalchemy.engines [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:58:06.118185 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writer thread running {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:58:06.118813 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_db.sqlalchemy.engines [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:58:06.121807 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writer thread running {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:58:06.255678 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writer thread running {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:58:06.261795 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writer thread running {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:58:06.265735 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO dbcounter [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Registered counter for database nova_cell0 Aug 31 03:58:06.276333 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG oslo_db.sqlalchemy.engines [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:58:06.277471 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO dbcounter [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Registered counter for database nova_cell0 Aug 31 03:58:06.283714 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writer thread running {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:58:06.288282 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_db.sqlalchemy.engines [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:58:06.293502 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writer thread running {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:58:06.637702 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: WARNING keystonemiddleware.auth_token [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 03:58:06.645268 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: WARNING keystonemiddleware.auth_token [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 03:58:06.645715 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: WARNING keystonemiddleware.auth_token [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 03:58:06.653161 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: WARNING keystonemiddleware.auth_token [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 03:58:06.982932 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: WARNING keystonemiddleware.auth_token [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 03:58:06.989051 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: WARNING keystonemiddleware.auth_token [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 03:58:06.994648 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5577bba6a9c0 pid: 105674 (default app) Aug 31 03:58:06.996760 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:58:06.996898 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: WARNING keystonemiddleware.auth_token [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 03:58:06.997959 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 Aug 31 03:58:06.998373 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Aug 31 03:58:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:58:07.002824 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: WARNING keystonemiddleware.auth_token [None req-014809f1-f4f0-4b93-b3a9-c1bd06354f1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 03:58:07.008595 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577bba6a9c0 pid: 105675 (default app) Aug 31 03:59:25.294487 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:25.295580 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 31 03:59:25.296288 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:25.308010 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writing DB stats nova_api:SELECT=3 {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:25.309133 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writing DB stats nova_cell1:SELECT=3 {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:25.309975 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writing DB stats nova_cell0:SELECT=3 {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:25.311055 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:26.192470 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-01a66225-1d79-43d7-a1b8-cb9b3ed5bb75 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:26.225290 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-01a66225-1d79-43d7-a1b8-cb9b3ed5bb75 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922381 Aug 31 03:59:26.226078 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 31 03:59:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:28.575134 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:28.576137 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-59029e51-cb1c-498a-a7ef-e1d11592d49b None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 31 03:59:28.576836 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:29.024540 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-f51e1b1d-2c48-4a33-924f-8e4e25e8afad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "disk": 1, "vcpus": 1, "id": "c1", "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:29.080290 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-f51e1b1d-2c48-4a33-924f-8e4e25e8afad admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495801 Aug 31 03:59:29.081252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:29.307549 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-0aa55ac7-3e06-43ce-bbe2-5dc94f7f8cbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:29.314157 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=3 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:29.314939 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_cell0:SELECT=3 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:29.315847 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_cell1:SELECT=3 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:29.316536 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:29.381660 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-0aa55ac7-3e06-43ce-bbe2-5dc94f7f8cbb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291366 Aug 31 03:59:29.382245 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 31 03:59:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:31.743843 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-f51e1b1d-2c48-4a33-924f-8e4e25e8afad admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:31.744858 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-f51e1b1d-2c48-4a33-924f-8e4e25e8afad admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 31 03:59:31.745235 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:32.416004 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-7f2c7c7b-11f6-4585-bc5e-a14f04614b1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:32.464119 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-7f2c7c7b-11f6-4585-bc5e-a14f04614b1c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712238 Aug 31 03:59:32.467074 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:32.477578 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-260f35e4-dc51-4548-99e9-c62076d6b464 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:32.517705 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-260f35e4-dc51-4548-99e9-c62076d6b464 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043925 Aug 31 03:59:32.518291 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 31 03:59:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:34.869491 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-7f2c7c7b-11f6-4585-bc5e-a14f04614b1c admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:34.870532 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-7f2c7c7b-11f6-4585-bc5e-a14f04614b1c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 31 03:59:34.870919 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:35.273669 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-1ff263cb-9f7b-4026-ab4a-fa0eb7de5738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:35.294907 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-1ff263cb-9f7b-4026-ab4a-fa0eb7de5738 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.417676 Aug 31 03:59:35.296163 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:35.308478 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-a5b1cfe8-b691-44bc-98bd-66eed520ad95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:35.333881 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-a5b1cfe8-b691-44bc-98bd-66eed520ad95 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029230 Aug 31 03:59:35.334476 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 31 03:59:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:37.665164 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-1ff263cb-9f7b-4026-ab4a-fa0eb7de5738 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:37.666143 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-1ff263cb-9f7b-4026-ab4a-fa0eb7de5738 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 31 03:59:37.666574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:38.085922 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fcd44c44-61f2-435a-912d-bc7acb4bffdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "disk": 10, "vcpus": 2, "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:38.106311 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fcd44c44-61f2-435a-912d-bc7acb4bffdb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433395 Aug 31 03:59:38.111345 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 03:59:38.119165 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-24a54790-f2e9-4cff-a52b-4309557e00a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:38.146644 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-24a54790-f2e9-4cff-a52b-4309557e00a1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031079 Aug 31 03:59:38.147456 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 31 03:59:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:40.559861 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fcd44c44-61f2-435a-912d-bc7acb4bffdb admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:40.562083 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fcd44c44-61f2-435a-912d-bc7acb4bffdb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002720 Aug 31 03:59:40.562618 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:40.998595 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-19534681-14a9-4f9a-b436-63bfca4d821f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "name": "ds4G", "id": "d4"}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:41.019109 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-19534681-14a9-4f9a-b436-63bfca4d821f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449843 Aug 31 03:59:41.022549 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:41.032113 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-5167837f-a46f-4a5a-83a7-c08621c098ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:41.058017 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-5167837f-a46f-4a5a-83a7-c08621c098ef admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029961 Aug 31 03:59:41.059535 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 31 03:59:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:43.586386 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-19534681-14a9-4f9a-b436-63bfca4d821f admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:43.587428 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-19534681-14a9-4f9a-b436-63bfca4d821f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 31 03:59:43.587863 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:44.025613 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-92ab1b8b-700c-44ca-985e-58a04dde4c37 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:44.050665 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-92ab1b8b-700c-44ca-985e-58a04dde4c37 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456589 Aug 31 03:59:44.051233 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 31 03:59:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 03:59:46.385931 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-19534681-14a9-4f9a-b436-63bfca4d821f admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:46.386940 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-19534681-14a9-4f9a-b436-63bfca4d821f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 31 03:59:46.387382 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:46.838581 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-f0efe2de-754e-4825-ba5f-ec259a9d0eba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:46.861113 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-f0efe2de-754e-4825-ba5f-ec259a9d0eba admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467126 Aug 31 03:59:46.863100 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:46.874832 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-6f565fdb-ce3c-4131-a448-6ec385136866 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:46.901585 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-6f565fdb-ce3c-4131-a448-6ec385136866 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030808 Aug 31 03:59:46.902164 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 31 03:59:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:49.721299 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-f0efe2de-754e-4825-ba5f-ec259a9d0eba admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:49.722299 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-f0efe2de-754e-4825-ba5f-ec259a9d0eba admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 31 03:59:49.722697 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:50.123389 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-6759be82-7f20-4bd8-ac10-a481bfce26c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "swap": 0, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:50.143159 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-6759be82-7f20-4bd8-ac10-a481bfce26c9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414423 Aug 31 03:59:50.143699 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:50.155640 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-379ad1da-b6c9-4621-bfd1-a55d3df247f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:50.180036 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-379ad1da-b6c9-4621-bfd1-a55d3df247f0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028112 Aug 31 03:59:50.180592 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 31 03:59:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:52.506761 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-6759be82-7f20-4bd8-ac10-a481bfce26c9 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:52.508545 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-6759be82-7f20-4bd8-ac10-a481bfce26c9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Aug 31 03:59:52.508947 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:52.898036 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-d5eec463-638e-4461-89cc-54706f62fd4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:52.919854 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-d5eec463-638e-4461-89cc-54706f62fd4b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.404040 Aug 31 03:59:52.920419 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:52.939096 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-fd639209-b748-4fa3-9790-eb4682d53e98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:52.969197 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-fd639209-b748-4fa3-9790-eb4682d53e98 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034122 Aug 31 03:59:52.970139 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 31 03:59:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:55.381030 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-d5eec463-638e-4461-89cc-54706f62fd4b admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:55.382027 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-d5eec463-638e-4461-89cc-54706f62fd4b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 03:59:55.387511 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:55 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:55.922048 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-d16e7980-fd67-40b5-965b-c60991fd55c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "disk": 80, "ram": 8192, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:55.928691 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:55.944053 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-d16e7980-fd67-40b5-965b-c60991fd55c6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.555044 Aug 31 03:59:55.945108 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:55.957577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-e4cbae3b-bab9-46fa-b5fe-0d897ed17e8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:55.984769 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-e4cbae3b-bab9-46fa-b5fe-0d897ed17e8c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031107 Aug 31 03:59:55.985681 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 31 03:59:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 03:59:58.345699 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-d16e7980-fd67-40b5-965b-c60991fd55c6 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 03:59:58.346737 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-d16e7980-fd67-40b5-965b-c60991fd55c6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 31 03:59:58.347162 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 03:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 03:59:58.778521 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-85106c2c-c570-4dd1-bbe4-f2f4bb2eb5f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "disk": 160, "name": "m1.xlarge", "swap": 0}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:58.802385 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-85106c2c-c570-4dd1-bbe4-f2f4bb2eb5f5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.448908 Aug 31 03:59:58.803166 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 31 03:59:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 03:59:58.815168 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-01dade6c-94ac-43d4-a424-5a591630418e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 03:59:58.840759 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-01dade6c-94ac-43d4-a424-5a591630418e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029312 Aug 31 03:59:58.841512 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 31 03:59:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:00:19.311840 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-85106c2c-c570-4dd1-bbe4-f2f4bb2eb5f5 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:19.312850 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-85106c2c-c570-4dd1-bbe4-f2f4bb2eb5f5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Aug 31 04:00:19.313280 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 04:00:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:19.327970 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:19.761399 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-50e1ca87-c5e1-47b6-8777-cfeb6921192e admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:19.785370 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-50e1ca87-c5e1-47b6-8777-cfeb6921192e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.465359 Aug 31 04:00:19.785897 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 31 04:00:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:00:20.858393 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-85106c2c-c570-4dd1-bbe4-f2f4bb2eb5f5 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:20.859422 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-85106c2c-c570-4dd1-bbe4-f2f4bb2eb5f5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Aug 31 04:00:20.859813 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:00:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:21.435547 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-fbd5f66a-360e-4b79-ab82-17885d499a7c admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:21.441578 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.wsgi [None req-fbd5f66a-360e-4b79-ab82-17885d499a7c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-fbd5f66a-360e-4b79-ab82-17885d499a7c admin admin] Request method failure captured: Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Accept: application/json Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Accept-Encoding: gzip, deflate Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Connection: keep-alive Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Content-Length: 0 Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Host: 10.222.0.18 Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Openstack-Api-Version: compute 2.90 Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Openstack-System-Scope: None Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: User-Agent: python-novaclient Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Auth-Token: gAAAAABjDtzUkAU9-lwrZjWbq8aCBQlUjR3F13d-eq33G_5v7UK_71dDtsvakVE5Yul9JsQID6CRBZkSQLqIOtW5S8IJiCApJTnAm74-x7e2GxpFf0t4Mql-aYEy05CBAGLHPupC_K7LDvG3RQI5p2OpS6pc-FPfSKYfubzQa2fS778tskc_kGo Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Domain-Id: None Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Domain-Name: None Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Identity-Status: Confirmed Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Is-Admin-Project: True Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Domain-Id: default Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Domain-Name: Default Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Name: admin Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Role: reader,admin,member Aug 31 04:00:21.444946 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Roles: reader,admin,member Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a624bee162274d80bf52fd9ee90c7807", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant: admin Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant-Name: admin Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User: admin Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Domain-Id: default Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Domain-Name: Default Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Id: 2be81f96a297433a9f04b4dfdb3e8453 Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Name: admin Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: method: > Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: exception: Flavor 42 could not be found. Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: action_args: {'id': '42'} Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:00:21.446474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:21.447369 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.449166 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-fbd5f66a-360e-4b79-ab82-17885d499a7c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:00:21.450464 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-fbd5f66a-360e-4b79-ab82-17885d499a7c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.450782 Aug 31 04:00:21.450464 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 31 04:00:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:21.457230 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-8d23239e-1eaf-42e4-aef6-1215f1a70eb4 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:21.463124 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:21.485195 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-8d23239e-1eaf-42e4-aef6-1215f1a70eb4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031621 Aug 31 04:00:21.485784 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 31 04:00:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:00:21.496297 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-87fd6da1-d7c4-43f7-8473-6c8e7d756b6d admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:21.520648 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-87fd6da1-d7c4-43f7-8473-6c8e7d756b6d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027957 Aug 31 04:00:21.521186 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 31 04:00:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:00:21.531295 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-eb54f2d5-156e-4112-ac6c-655c1b51c752 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:21.537382 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.wsgi [None req-eb54f2d5-156e-4112-ac6c-655c1b51c752 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-eb54f2d5-156e-4112-ac6c-655c1b51c752 admin admin] Request method failure captured: Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Accept: application/json Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Accept-Encoding: gzip, deflate Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Connection: keep-alive Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Content-Length: 0 Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Host: 10.222.0.18 Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Openstack-Api-Version: compute 2.90 Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Openstack-System-Scope: None Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: User-Agent: python-novaclient Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Auth-Token: gAAAAABjDtzUkAU9-lwrZjWbq8aCBQlUjR3F13d-eq33G_5v7UK_71dDtsvakVE5Yul9JsQID6CRBZkSQLqIOtW5S8IJiCApJTnAm74-x7e2GxpFf0t4Mql-aYEy05CBAGLHPupC_K7LDvG3RQI5p2OpS6pc-FPfSKYfubzQa2fS778tskc_kGo Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Domain-Id: None Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Domain-Name: None Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Identity-Status: Confirmed Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Is-Admin-Project: True Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Domain-Id: default Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Domain-Name: Default Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Name: admin Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Role: reader,admin,member Aug 31 04:00:21.540577 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Roles: reader,admin,member Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a624bee162274d80bf52fd9ee90c7807", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant: admin Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant-Name: admin Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User: admin Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Domain-Id: default Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Domain-Name: Default Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Id: 2be81f96a297433a9f04b4dfdb3e8453 Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Name: admin Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: method: > Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: exception: Flavor 42 could not be found. Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: action_args: {'id': '42'} Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:00:21.542070 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:21.543054 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:21.544217 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-eb54f2d5-156e-4112-ac6c-655c1b51c752 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:00:21.545447 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-eb54f2d5-156e-4112-ac6c-655c1b51c752 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014638 Aug 31 04:00:21.545447 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 31 04:00:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:22.525406 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-87fd6da1-d7c4-43f7-8473-6c8e7d756b6d admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:22.526419 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-87fd6da1-d7c4-43f7-8473-6c8e7d756b6d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 04:00:22.526804 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:00:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:23.097484 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fb75d264-9d85-4e3a-8f37-f6ae7233cb2b admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:23.102923 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.wsgi [None req-fb75d264-9d85-4e3a-8f37-f6ae7233cb2b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fb75d264-9d85-4e3a-8f37-f6ae7233cb2b admin admin] Request method failure captured: Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Accept: application/json Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Accept-Encoding: gzip, deflate Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Connection: keep-alive Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Content-Length: 0 Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Host: 10.222.0.18 Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Openstack-Api-Version: compute 2.90 Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Openstack-System-Scope: None Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: User-Agent: python-novaclient Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Auth-Token: gAAAAABjDtzWCp0obUdY33zCb0lYdllx2ZjXSRwPF4F99Mfxa5ceylIk0gbUMYre8MZVjZvHuNRfJuyc5ZboDreD2oYel9DsyAtcXn2TsUu2zJnCKEpApT5bXelgEygZyTH-WB3bNf7dCZ--ul8-uL3JdCgI4MG-dqa-HVIsZ2ZqymuI5z8DlwQ Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Domain-Id: None Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Domain-Name: None Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Identity-Status: Confirmed Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Is-Admin-Project: True Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Domain-Id: default Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Domain-Name: Default Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Name: admin Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Role: reader,admin,member Aug 31 04:00:23.104444 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Roles: reader,admin,member Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a624bee162274d80bf52fd9ee90c7807", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant: admin Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant-Name: admin Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User: admin Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Domain-Id: default Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Domain-Name: Default Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Id: 2be81f96a297433a9f04b4dfdb3e8453 Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Name: admin Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: method: > Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: exception: Flavor 84 could not be found. Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: action_args: {'id': '84'} Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:00:23.105741 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:23.106563 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.107905 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fb75d264-9d85-4e3a-8f37-f6ae7233cb2b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:00:23.109218 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fb75d264-9d85-4e3a-8f37-f6ae7233cb2b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.443610 Aug 31 04:00:23.109218 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 31 04:00:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:23.116719 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-dbaff21b-d17a-4e14-ae9e-2c2bd768975e admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:23.131858 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-dbaff21b-d17a-4e14-ae9e-2c2bd768975e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019119 Aug 31 04:00:23.132425 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 31 04:00:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:00:23.141998 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-42ec26a1-42ce-44ea-93cb-456359e07644 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:23.157240 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-42ec26a1-42ce-44ea-93cb-456359e07644 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018820 Aug 31 04:00:23.157793 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 31 04:00:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:00:23.168096 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-d63cb221-7296-404b-b33c-5e0552a2fa22 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:23.176395 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.wsgi [None req-d63cb221-7296-404b-b33c-5e0552a2fa22 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-d63cb221-7296-404b-b33c-5e0552a2fa22 admin admin] Request method failure captured: Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Accept: application/json Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Accept-Encoding: gzip, deflate Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Connection: keep-alive Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Content-Length: 0 Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Host: 10.222.0.18 Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Openstack-Api-Version: compute 2.90 Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Openstack-System-Scope: None Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: User-Agent: python-novaclient Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Auth-Token: gAAAAABjDtzWCp0obUdY33zCb0lYdllx2ZjXSRwPF4F99Mfxa5ceylIk0gbUMYre8MZVjZvHuNRfJuyc5ZboDreD2oYel9DsyAtcXn2TsUu2zJnCKEpApT5bXelgEygZyTH-WB3bNf7dCZ--ul8-uL3JdCgI4MG-dqa-HVIsZ2ZqymuI5z8DlwQ Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Domain-Id: None Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Domain-Name: None Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Identity-Status: Confirmed Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Is-Admin-Project: True Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Domain-Id: default Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Domain-Name: Default Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Name: admin Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Role: reader,admin,member Aug 31 04:00:23.178774 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Roles: reader,admin,member Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a624bee162274d80bf52fd9ee90c7807", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant: admin Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant-Name: admin Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User: admin Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Domain-Id: default Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Domain-Name: Default Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Id: 2be81f96a297433a9f04b4dfdb3e8453 Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Name: admin Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: method: > Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: exception: Flavor 84 could not be found. Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: action_args: {'id': '84'} Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:00:23.180474 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:23.181628 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:23.183092 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-d63cb221-7296-404b-b33c-5e0552a2fa22 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:00:23.184344 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-d63cb221-7296-404b-b33c-5e0552a2fa22 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016274 Aug 31 04:00:23.184344 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 31 04:00:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:24.165322 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-42ec26a1-42ce-44ea-93cb-456359e07644 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:24.166314 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-42ec26a1-42ce-44ea-93cb-456359e07644 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 31 04:00:24.166703 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:00:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:24.723754 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-8382e8ca-09cf-4493-bf25-94ff4aea6a13 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:24.729878 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.wsgi [None req-8382e8ca-09cf-4493-bf25-94ff4aea6a13 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-8382e8ca-09cf-4493-bf25-94ff4aea6a13 admin admin] Request method failure captured: Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Accept: application/json Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Accept-Encoding: gzip, deflate Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Connection: keep-alive Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Content-Length: 0 Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Host: 10.222.0.18 Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Openstack-Api-Version: compute 2.90 Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Openstack-System-Scope: None Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: User-Agent: python-novaclient Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Auth-Token: gAAAAABjDtzYfsUDfl3PBEc4N9OYaQLfTnEb6XEf0dxrc0-Jla1TXPP4HWJYAVNEcEyHSPkKNSZqOKaCT4j2gSKHR49TdmyN77b8H0KoeiMH-M0emD2LJF_zHmCO19rG9cArRmNOLpDCPTkQDPZlRN2nCTS7iyOrTDjDXJAr6gijXweAFaagPI4 Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Domain-Id: None Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Domain-Name: None Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Identity-Status: Confirmed Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Is-Admin-Project: True Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Domain-Id: default Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Domain-Name: Default Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Project-Name: admin Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Role: reader,admin,member Aug 31 04:00:24.731401 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Roles: reader,admin,member Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a624bee162274d80bf52fd9ee90c7807", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant: admin Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-Tenant-Name: admin Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User: admin Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Domain-Id: default Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Domain-Name: Default Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Id: 2be81f96a297433a9f04b4dfdb3e8453 Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: X-User-Name: admin Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: method: > Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: exception: Flavor 451 could not be found. Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: action_args: {'id': '451'} Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:00:24.732899 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:24.735574 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.737252 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-8382e8ca-09cf-4493-bf25-94ff4aea6a13 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:00:24.739062 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-8382e8ca-09cf-4493-bf25-94ff4aea6a13 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.431522 Aug 31 04:00:24.739062 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 31 04:00:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:24.743429 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-99c43bb3-e1ff-41c1-aa8e-e9795127ea47 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:24.758700 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-99c43bb3-e1ff-41c1-aa8e-e9795127ea47 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018912 Aug 31 04:00:24.759290 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 31 04:00:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:00:24.768933 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:24.783685 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018277 Aug 31 04:00:24.784204 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 31 04:00:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:00:24.793267 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-78e169a2-5201-4c18-8d77-3129cca2f738 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:24.799187 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.wsgi [None req-78e169a2-5201-4c18-8d77-3129cca2f738 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-78e169a2-5201-4c18-8d77-3129cca2f738 admin admin] Request method failure captured: Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Accept: application/json Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Accept-Encoding: gzip, deflate Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Connection: keep-alive Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Content-Length: 0 Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Host: 10.222.0.18 Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Openstack-Api-Version: compute 2.90 Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Openstack-System-Scope: None Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: User-Agent: python-novaclient Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Auth-Token: gAAAAABjDtzYfsUDfl3PBEc4N9OYaQLfTnEb6XEf0dxrc0-Jla1TXPP4HWJYAVNEcEyHSPkKNSZqOKaCT4j2gSKHR49TdmyN77b8H0KoeiMH-M0emD2LJF_zHmCO19rG9cArRmNOLpDCPTkQDPZlRN2nCTS7iyOrTDjDXJAr6gijXweAFaagPI4 Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Domain-Id: None Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Domain-Name: None Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Identity-Status: Confirmed Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Is-Admin-Project: True Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Domain-Id: default Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Domain-Name: Default Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Project-Name: admin Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Role: reader,admin,member Aug 31 04:00:24.800675 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Roles: reader,admin,member Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a624bee162274d80bf52fd9ee90c7807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a624bee162274d80bf52fd9ee90c7807", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant: admin Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant-Id: a624bee162274d80bf52fd9ee90c7807 Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-Tenant-Name: admin Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User: admin Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Domain-Id: default Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Domain-Name: Default Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Id: 2be81f96a297433a9f04b4dfdb3e8453 Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: X-User-Name: admin Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: method: > Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: exception: Flavor 451 could not be found. Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: action_args: {'id': '451'} Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:00:24.802197 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:24.803141 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Aug 31 04:00:24.804183 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-78e169a2-5201-4c18-8d77-3129cca2f738 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:00:24.805157 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-78e169a2-5201-4c18-8d77-3129cca2f738 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012229 Aug 31 04:00:24.805157 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 31 04:00:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 04:00:25.803379 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:25.805066 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002302 Aug 31 04:00:25.805674 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:00:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:26.379897 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-92d2e634-b722-4f87-8de2-65871c8d0017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:00:26.401300 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-92d2e634-b722-4f87-8de2-65871c8d0017 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.458187 Aug 31 04:00:26.401804 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 31 04:00:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:00:27.403389 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:27.404575 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Aug 31 04:00:27.404971 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:00:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:27.970326 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-12947cc3-863f-4197-9aa8-aec9311d04bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:00:27.990949 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-12947cc3-863f-4197-9aa8-aec9311d04bc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.450981 Aug 31 04:00:27.991521 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 31 04:00:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:00:28.965198 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:28.966193 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 31 04:00:28.966756 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:29.562761 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-0e750d80-10b1-4b8a-8c04-0e7e9e582033 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:00:29.583869 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-0e750d80-10b1-4b8a-8c04-0e7e9e582033 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.464614 Aug 31 04:00:29.584398 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 31 04:00:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:00:30.564736 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:30.565749 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 31 04:00:30.566148 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:00:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:31.120882 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-31cb7ed5-052c-4fbd-b5dc-b88c32237e01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:00:31.140526 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-31cb7ed5-052c-4fbd-b5dc-b88c32237e01 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.433303 Aug 31 04:00:31.141064 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 31 04:00:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:00:32.163368 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:32.164924 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 Aug 31 04:00:32.165529 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:00:32.721386 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-88918112-adf0-459a-9902-9f42dac30cc7 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:00:32.749973 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-88918112-adf0-459a-9902-9f42dac30cc7 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.449179 Aug 31 04:00:32.750525 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Aug 31 04:00:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:01:26.583070 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:01:26.584100 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-cdcd0523-6dc3-4157-a27e-5570434fc473 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 04:01:26.584495 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 31 04:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:01:26.596204 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:27.036104 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-999b24f0-172e-426c-83f1-f2789ec4c7fa admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:01:27.057395 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-999b24f0-172e-426c-83f1-f2789ec4c7fa admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.466280 Aug 31 04:01:27.057927 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 31 04:01:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:01:27.079292 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG dbcounter [-] [105675] Writing DB stats nova_api:SELECT=14 {{(pid=105675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:27.083491 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-956bcb5f-ab34-49f2-98c4-1669aa654344 admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:01:27.091239 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-956bcb5f-ab34-49f2-98c4-1669aa654344 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013357 Aug 31 04:01:27.092198 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Aug 31 04:01:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:01:27.106979 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-28641dd1-64ff-4481-b3d9-79672ce4591e admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:01:27.116168 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-28641dd1-64ff-4481-b3d9-79672ce4591e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014796 Aug 31 04:01:27.116546 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Aug 31 04:01:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:01:27.128435 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:01:27.136416 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011693 Aug 31 04:01:27.136919 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Aug 31 04:01:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:01:27.148612 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-17551b3e-8aa6-4c75-8ed3-06e397f505ad admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:01:27.156788 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-17551b3e-8aa6-4c75-8ed3-06e397f505ad admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011765 Aug 31 04:01:27.157311 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Aug 31 04:01:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:04:22.456294 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:04:22.457599 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Aug 31 04:04:22.458054 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:04:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:04:22.597614 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=6 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:04:22.770826 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-f7817836-2ea2-4d58-9a21-09ab6b4d5f4a admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:04:22.774514 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-f7817836-2ea2-4d58-9a21-09ab6b4d5f4a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:04:22.774972 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-f7817836-2ea2-4d58-9a21-09ab6b4d5f4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:04:22.775424 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-f7817836-2ea2-4d58-9a21-09ab6b4d5f4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:04:22.776144 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-f7817836-2ea2-4d58-9a21-09ab6b4d5f4a admin admin] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:04:22.776578 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-f7817836-2ea2-4d58-9a21-09ab6b4d5f4a admin admin] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:04:22.776997 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-f7817836-2ea2-4d58-9a21-09ab6b4d5f4a admin admin] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:04:22.813626 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-f7817836-2ea2-4d58-9a21-09ab6b4d5f4a admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.217463 Aug 31 04:04:22.814216 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 31 04:04:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:04:23.668784 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:04:23.669810 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 04:04:23.670197 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:04:23.873862 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-d447c63b-1352-4bd5-8637-8c558c3e15be admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:04:23.877204 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-d447c63b-1352-4bd5-8637-8c558c3e15be admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:04:23.877684 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-d447c63b-1352-4bd5-8637-8c558c3e15be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:04:23.878107 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-d447c63b-1352-4bd5-8637-8c558c3e15be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:04:23.878804 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-d447c63b-1352-4bd5-8637-8c558c3e15be admin admin] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:04:23.879286 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-d447c63b-1352-4bd5-8637-8c558c3e15be admin admin] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:04:23.879695 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-d447c63b-1352-4bd5-8637-8c558c3e15be admin admin] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:04:23.898907 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-d447c63b-1352-4bd5-8637-8c558c3e15be admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081019 Aug 31 04:04:23.899511 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 31 04:04:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:04:35.153135 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:04:35.154230 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 31 04:04:35.154666 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:04:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:04:35.301569 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_cell0:SELECT=4 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:04:35.302381 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_cell1:SELECT=4 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:04:35.303000 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=8 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:04:35.353336 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-123c50f8-4cd2-472e-93bb-da1c52449e18 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:04:35.356760 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-123c50f8-4cd2-472e-93bb-da1c52449e18 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:04:35.357229 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-123c50f8-4cd2-472e-93bb-da1c52449e18 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:04:35.357652 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-123c50f8-4cd2-472e-93bb-da1c52449e18 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:04:35.358349 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-123c50f8-4cd2-472e-93bb-da1c52449e18 admin admin] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:04:35.358785 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-123c50f8-4cd2-472e-93bb-da1c52449e18 admin admin] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:04:35.359226 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-123c50f8-4cd2-472e-93bb-da1c52449e18 admin admin] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:04:35.384434 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-123c50f8-4cd2-472e-93bb-da1c52449e18 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090258 Aug 31 04:04:35.384986 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 31 04:04:35 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:04:36.228019 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: DEBUG nova.api.openstack.wsgi [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] Calling method '>' {{(pid=105675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:04:36.229025 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: INFO nova.api.openstack.requestlog [None req-1d9af56b-dee1-4682-83b6-6fe2a5a8dcdc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 04:04:36.229426 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: [pid: 105675|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 31 04:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:04:36.426363 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-051ca6bd-3116-4fe0-bd16-30d7d897d6de admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:04:36.429993 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-051ca6bd-3116-4fe0-bd16-30d7d897d6de admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:04:36.430419 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-051ca6bd-3116-4fe0-bd16-30d7d897d6de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:04:36.430847 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-051ca6bd-3116-4fe0-bd16-30d7d897d6de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:04:36.431585 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-051ca6bd-3116-4fe0-bd16-30d7d897d6de admin admin] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:04:36.432030 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-051ca6bd-3116-4fe0-bd16-30d7d897d6de admin admin] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:04:36.432447 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-051ca6bd-3116-4fe0-bd16-30d7d897d6de admin admin] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:04:36.454090 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-051ca6bd-3116-4fe0-bd16-30d7d897d6de admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088210 Aug 31 04:04:36.454844 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 31 04:04:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:05:32.748042 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: Wed Aug 31 04:05:32 2022 - graceful shutdown triggered... Aug 31 04:05:32.748129 dv-cinder-853910-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 04:05:32.749401 dv-cinder-853910-5-iscsi devstack@n-api.service[105674]: Gracefully killing worker 1 (pid: 105674)... Aug 31 04:05:32.749792 dv-cinder-853910-5-iscsi devstack@n-api.service[105675]: Gracefully killing worker 2 (pid: 105675)... Aug 31 04:05:33.750393 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: worker 1 buried after 1 seconds Aug 31 04:05:33.750393 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: worker 2 buried after 1 seconds Aug 31 04:05:33.750393 dv-cinder-853910-5-iscsi devstack@n-api.service[105673]: goodbye to uWSGI. Aug 31 04:05:33.752124 dv-cinder-853910-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 04:05:33.753149 dv-cinder-853910-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 04:05:33.757402 dv-cinder-853910-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 04:05:33.773581 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 04:05:33 2022] *** Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: nodename: dv-cinder-853910-5-iscsi Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: machine: x86_64 Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: clock source: unix Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: pcre jit disabled Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: detected number of CPU cores: 4 Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: current working directory: / Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: detected binary path: /usr/bin/uwsgi-core Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: your processes number limit is 47680 Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: your memory page size is 4096 bytes Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: detected max file descriptor number: 2048 Aug 31 04:05:33.776714 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: lock engine: pthread robust mutexes Aug 31 04:05:33.778181 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: thunder lock: enabled Aug 31 04:05:33.778181 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 04:05:33.778181 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 04:05:33.820081 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: Python main interpreter initialized at 0x55c95c3399c0 Aug 31 04:05:33.820081 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: python threads support enabled Aug 31 04:05:33.820081 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: your server socket listen backlog is limited to 100 connections Aug 31 04:05:33.820081 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: your mercy for graceful operations on workers is 90 seconds Aug 31 04:05:33.820574 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 04:05:33.820574 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: *** Operational MODE: preforking *** Aug 31 04:05:33.820813 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: *** uWSGI is running in multiple interpreter mode *** Aug 31 04:05:33.820813 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: spawned uWSGI master process (pid: 120642) Aug 31 04:05:33.821011 dv-cinder-853910-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 04:05:33.822805 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: spawned uWSGI worker 1 (pid: 120661, cores: 1) Aug 31 04:05:33.822805 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: spawned uWSGI worker 2 (pid: 120662, cores: 1) Aug 31 04:05:33.822805 dv-cinder-853910-5-iscsi devstack@n-api.service[120642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 04:05:34.483245 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 04:05:34.493971 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 04:05:35.622694 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:05:35.622694 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: from cryptography.utils import int_from_bytes Aug 31 04:05:35.623389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:05:35.623389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: from cryptography.utils import int_from_bytes Aug 31 04:05:35.632411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:05:35.632411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: from cryptography.utils import int_from_bytes Aug 31 04:05:35.632985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:05:35.632985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: from cryptography.utils import int_from_bytes Aug 31 04:05:38.023668 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 04:05:38.024348 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 04:05:38.024448 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 04:05:38.024767 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 04:05:38.025013 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 04:05:38.025427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.025761 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.026086 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.026394 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.026904 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.027246 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.027571 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.027938 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.028265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.028537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.028860 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.029216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-5-iscsi {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.029510 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.029830 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.030142 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.030521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.030762 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.031117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.031460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.031960 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.033533 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.033533 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.033533 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.033813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.034067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.034377 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.034731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.035010 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.035372 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.035690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.036114 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-5-iscsi {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.036442 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.036744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.037049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.037493 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.037800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.038120 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.038448 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.038765 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.039080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.039429 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.039753 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.040069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.040389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.040683 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.040993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.041304 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.041625 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.041936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.042241 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.042492 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.042803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.043149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.043473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.043806 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.044057 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.044330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.044632 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.044964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.045284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.045589 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.045899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.046208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.046510 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.046822 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.047133 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.047453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.047776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.048088 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.048419 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.048788 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.049144 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.049559 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.049809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.050202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.050582 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.050904 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.051249 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.051568 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.051892 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.052198 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.052504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.052796 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.053134 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.053453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.053758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.054010 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.054340 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.054634 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.054948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.055278 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.055585 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.055899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.056208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.056515 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.056821 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.057123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.057430 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.057739 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.058047 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.058355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.058658 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.058958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.059298 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.059623 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.059934 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.060242 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.060553 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.060856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.061171 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.061512 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.061678 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 04:05:38.062208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 04:05:38.062374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.062374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.062649 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 04:05:38.062800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.062955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 04:05:38.063176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.063330 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 04:05:38.063474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.063474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.063776 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.063927 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.064087 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.064238 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.064455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.064606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.064781 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.064949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.064949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.065256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.065408 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.065567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.065729 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.065896 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.066047 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.066191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.066333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.066482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.066637 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.066798 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.066951 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.067127 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.067289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.067447 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.067612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-5-iscsi {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.067813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.067968 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.068135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.068282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.068431 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.068588 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.069191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.069348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.069503 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.069669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.069831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.070000 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.070152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.070314 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.070549 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.070549 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.071693 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.071893 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.072045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.072188 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.072340 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.072340 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.072631 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.072784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.072939 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.073091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.073235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.073386 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.073548 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.073700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.073852 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.074104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.074267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.074519 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.074676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.074833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.074988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.074988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.075320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-5-iscsi {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.075472 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.075615 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.075765 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.075907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.076060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.076219 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.076369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.076513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.076656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.076799 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.076998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.077163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.077315 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.077475 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.077621 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.077775 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.077925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.078082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.078226 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.078377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.078528 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.078677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.078873 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.079543 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.079720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.079871 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.080029 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.080173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.080329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.080482 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.080735 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.080886 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.081030 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.081173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.081338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.081501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.081799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.081962 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.082106 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.082265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.082265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.082550 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.082550 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.082831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.082981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.083177 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.083330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.083330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.083636 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.083784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.083938 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.084120 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.084355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.084514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.084666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.084817 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.084976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.085128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.085273 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.085426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.085570 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.085712 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.085877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.086031 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.086201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.086967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.087208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.087362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.087523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.087667 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.087811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.087961 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.088124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.088267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.088425 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.088577 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.088720 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.088863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.089014 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.089186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.089786 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.090033 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.090191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.090343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.090497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.090671 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.091062 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.091217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.091373 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.091516 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.091661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.091871 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.092147 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.092305 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.092451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.092604 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.092757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.092914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.093111 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.093267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.093412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.093554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.093711 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.093855 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.093998 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.094155 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.094353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.094572 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.094739 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.094892 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.095074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.095245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.095389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.095551 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.095763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.095910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.096065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.096216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.096376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.096521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.096673 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.096816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.096973 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.097141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.097304 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.097455 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.097610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.097763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.097914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.098064 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.098218 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.098361 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.098503 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.098659 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.098811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.098954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.099175 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.099323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.099958 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.099958 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.100252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.100403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.100504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.100594 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.100693 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.100693 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.100867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.100954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.101249 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.101354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.101453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.101547 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.101633 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.101726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.101812 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.101953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.102056 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.102165 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.102263 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.102446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.102536 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.102630 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.102717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.102808 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.102902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.102996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.102996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.103197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.103291 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.103386 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.103486 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.103574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.103574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.103574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.103574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.103874 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.103972 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.103972 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.103972 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.104227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.104313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.104313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.104313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.104736 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.104833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.104833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.104833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.104833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.104833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.105233 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.105326 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.105326 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.105326 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.105569 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.105655 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.105785 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.106095 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.106235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.106425 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:05:38.106739 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.106842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.107135 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.107378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.107473 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.107788 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.107978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.108122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.108456 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.108547 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.108776 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.109050 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.109151 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.109389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.109798 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.110155 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.110155 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.110353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.110455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.111194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.111365 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.111466 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.111553 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.111658 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.111754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.111841 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.112212 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.112312 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.112547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.112794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.112890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.113179 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.113360 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.113509 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.113844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.113938 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.114171 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.114437 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.114539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.114826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.115073 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.115554 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.115911 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.116022 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.116207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.116517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.116619 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.116834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.117097 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.117198 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.117444 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.117686 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.117798 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.118096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.118313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.118414 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.118722 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.118923 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.119059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.119379 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.119540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.119901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.120025 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.120370 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.120469 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.120609 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.120705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.120925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.121190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.121294 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.121573 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.121773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.121900 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.122217 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.122347 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.122540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.122858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.122955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.123197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.123517 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.123838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.124145 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.124316 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.124457 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.124915 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.125103 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.125209 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.125516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.125625 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.125713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.126015 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.126123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.126329 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.126604 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.126707 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.127059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.127300 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.127588 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.127811 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.128039 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.128333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.128435 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.128661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.128921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.129028 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.129281 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.129509 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.129614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.130966 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.130966 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.131225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.131324 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.131420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.131784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.131872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.131968 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.131968 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.132270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.132359 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.132359 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.132533 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.132629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.132629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.132923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.133128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.133249 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.133567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.133704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.133880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.134222 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.134317 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.134556 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.134800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.134909 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.135216 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.135468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.135663 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.135826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.135962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.136130 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.136440 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.136534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.136747 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.137037 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.137227 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.137343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.137621 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.137723 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.137941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.138198 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.138305 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.138534 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.138786 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.138880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.139151 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.139476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.139579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.139786 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.140050 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.140145 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.140392 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.140624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.140719 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.141107 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.141217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.141306 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.141641 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.141748 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.141981 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.142259 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.142368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.142858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.142962 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.143439 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.143666 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.143768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.144067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.144246 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.144391 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.144710 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.144837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.145026 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.145356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.145461 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.145669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.145941 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.146043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.146291 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.146519 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.146621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.146917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.147113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.147268 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.147577 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.147671 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.147898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.148221 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.148315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.148562 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.148797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.148890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.149192 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.149367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.149505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.149820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.149920 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.150134 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.150500 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.150609 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.150756 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.151752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.151850 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.151937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.152022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.152022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.152193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.152413 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.152413 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.152608 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.152771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.153112 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.153221 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.153356 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.153511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.153829 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.153963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.154165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.154436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.154532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.154802 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.155070 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.155182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.155448 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.155640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.155755 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.156045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.156230 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.156353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.156661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.156809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.156970 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.157279 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.157379 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.157595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.157895 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.157989 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.158333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.158640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.158873 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.159131 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.159295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.159581 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.159733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.159915 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.160076 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.160412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.160745 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.160890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.160890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.161155 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.161596 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.161755 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.161755 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.162038 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.162189 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.162466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.162611 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.162780 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.162930 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.163125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.163290 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.163450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.163589 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.163821 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.163961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.164422 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.164596 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.164744 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.164883 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.165028 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.165183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.165333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166000 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166291 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166599 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.166781 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.167092 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.167195 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.167282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.167436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.167584 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.167756 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.167899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.168072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.168214 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.168391 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.168529 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.168705 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.168843 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.169020 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.169167 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.169332 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.169480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.169644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.169793 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.169970 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.170108 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.170281 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.170417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.170602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.170737 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.170953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.171155 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.171362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.171686 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.171801 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.172001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.172108 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.172315 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.172427 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.172630 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.172733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.172983 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.173094 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.173293 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.173402 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.173663 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.173847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.174078 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.174413 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.174523 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.174844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.174956 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.175186 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.175302 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.175505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.175598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.175817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.175930 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.176127 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.176228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.176438 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.176545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.176747 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.176847 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.177057 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.177148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.177364 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.177463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.177673 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.177774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.177981 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.178080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.178287 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.178388 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.178594 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.178698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.178901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.178994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.179239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.179342 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.179552 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.179645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.179864 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.179959 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.180173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.180266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.180499 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.180594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.180805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.180900 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.181112 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.181205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.181421 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.181514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.181725 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.181812 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.182039 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.182134 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.182348 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.182441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.182669 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.182762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.182979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.183136 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.183312 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.183405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.183622 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.183729 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.183940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.184042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.184252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.184344 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.184562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.184663 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.184866 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.184971 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.185172 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.185265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.185485 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.185587 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.185791 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.185878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.186092 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.186186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.186398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.186490 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.186708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.186800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.187018 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.187139 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.187360 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.187452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.187670 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.187764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.187979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.188078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.188282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.188369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.188591 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.188681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.188900 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.188982 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.189206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.189319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.189698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.189799 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.190055 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.190241 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.190370 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.190562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.190677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.190876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.190990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.191217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.191322 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.191529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.191640 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.191864 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.191946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.192181 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.192263 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.192492 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.192575 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.193829 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.193942 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194085 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194177 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194257 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194659 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194732 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.194981 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.195090 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196039 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196132 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196205 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196587 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196657 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196734 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196812 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.196972 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.197080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.197282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.197382 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.197592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.197684 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.197900 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.198001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.198206 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.198288 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.198516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.198607 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.198823 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.198917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.199154 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.199251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.199463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.199564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.199768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.199860 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.200074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.200166 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.200398 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.200498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.200707 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.200800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.201015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.201114 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.201323 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.201430 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.201629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.201721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.201944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.202043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.202267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.202368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.202584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.202676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.202904 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.203007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.203247 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.203345 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.203560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.203653 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.203875 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.203966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.204187 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.204287 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.204501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.204602 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.204804 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.204924 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.205249 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.205342 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.205692 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.205797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.206008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.206104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.206314 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.206406 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.206624 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.206716 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.206929 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.207100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.207276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.207421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.207595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.207742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.207920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.208061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.208249 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.208374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.208578 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.208692 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.208887 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.208993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.209198 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.209324 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.209512 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.209647 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.209824 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.210004 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.210140 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.210376 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.210477 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.210698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.210798 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.211019 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.211130 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.211369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.211471 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.211680 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.211773 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.211989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.212083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.212296 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.212389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.212611 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.212713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.212917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.213016 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.213222 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.213311 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.213529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.213635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.213844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.213943 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.214148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.214240 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.214463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.214564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.214774 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.214887 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.215111 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.215242 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.215419 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.215554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.215857 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.215981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.216172 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.216300 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.216486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.216614 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.216795 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.216941 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.217108 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.217270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.217423 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.217600 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.217746 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.217910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.218064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.218229 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.218372 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.218546 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.218799 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.218899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.219148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.219255 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.219467 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.219562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.219783 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.219885 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.220091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.220193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.220398 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.220491 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.220898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.221009 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.221220 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.221433 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.221536 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.221753 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.221960 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.222054 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.222294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.222396 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.222612 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.222713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.222943 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.223082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.223301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.223395 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.223615 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.223733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.223926 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.224050 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.224241 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.224360 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.224559 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.224794 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.224887 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.225132 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.225231 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.225427 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.225561 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.225752 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.225887 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.226077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.226208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.226404 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.226526 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.226712 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.226819 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.227045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.227154 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.227367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.227466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.227693 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.227795 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.228022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.228123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.228338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.228431 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.228659 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.228762 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.228969 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.229059 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.229297 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.229398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.229622 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.229714 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.229937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.230037 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.230247 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.230343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.230556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.230651 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.230866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.230973 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.231235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.231341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.231550 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.231651 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.231874 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.231967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.232208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.232300 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.232533 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.232621 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.232846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.232946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.233153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.233253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.233463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.233552 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.233790 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.233877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.234097 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.234199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.234415 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.234507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.234735 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.234836 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.235077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.235188 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.235378 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.235471 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.235686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.235785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.235993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.236094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.236335 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.236446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.236643 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.236919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.237039 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.237243 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.237343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.237548 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.237642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.237876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.237977 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.238182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.238273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.238504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.238603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.238815 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.238921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.239142 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.239247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.239452 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.239551 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.239760 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.239863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.240102 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.240529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.240737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.240835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.241059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.241150 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.241370 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.241469 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.241697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.241789 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.242009 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.242109 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.242326 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.242425 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.242648 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.242740 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.242969 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.243087 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.243318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.243412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.243640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.243722 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.243949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.244037 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.244255 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.244347 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.244573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.244672 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.244879 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.244978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.245188 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.245281 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.245493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.245753 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.245847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.246092 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.246194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.246397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.246492 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.246704 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.246797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.247065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.247162 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.247358 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.247452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.247681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.247776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.247993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.248092 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.248300 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.248401 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.248607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.248708 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.248914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.249006 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.249251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.249350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.249555 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.249646 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.249888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.249987 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.250204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.250311 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.250529 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.250622 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.250846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.250935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.251186 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.251290 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.251506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.251597 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.251882 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.251990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.252236 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.252442 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.252535 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.252814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.252907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.253145 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.253247 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.253462 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.253557 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.253777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.253866 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.254096 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.254184 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.254415 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.254514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.254728 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.254967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.255111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.255331 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.255431 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.255652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.255752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.255968 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.256070 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.256284 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.256384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.256604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.256704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.256923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.257027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.257238 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.257338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.257550 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.257642 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.257865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.257957 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.258175 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.258392 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.258494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.258714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.258816 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.259072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.259169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.259409 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.259503 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.259742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.259847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.260065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.260157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.260387 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.260480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.260702 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.260802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.261019 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.261117 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.261330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.261426 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.261644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.261737 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.261960 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.262060 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.262269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.262445 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.262583 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.262674 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.262899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.262991 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.263229 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.263336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.263545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.263691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.263859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.263983 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.264170 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.264484 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.264612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.264797 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.264914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.265112 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.265250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.265440 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.265558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.265774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.265897 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.266093 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.266219 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.266401 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.266525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.266716 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.266841 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.267033 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.267170 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.267352 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.267654 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.267774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.267998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.268221 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.268385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.268573 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.268691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.268897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.269013 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.269208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.269335 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.269514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.269633 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.270369 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.270505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.270505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.270687 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.270775 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.270860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.270943 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.271047 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.271150 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.271248 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.271371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.271476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.271677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.271771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.271987 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.272086 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.272297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.272400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.272602 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.272704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.272907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.273006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.273222 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.273358 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.273529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.273892 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.274000 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.274157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.274249 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.274473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.274564 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.274783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.274878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.275118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.275227 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.275464 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.275558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.275776 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.275870 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.276093 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.276192 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.276401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.276543 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.276709 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.276815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.277027 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.277128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.277340 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.277446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.277646 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.277747 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.277952 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.278053 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.278262 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.278413 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.278574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.278676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.278878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.279211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.279356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.279517 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.279637 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.279848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.279964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.280158 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.280285 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.280462 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.280580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.280770 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.280888 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.281085 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.281211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.281392 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.281516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.281698 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.281821 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.282007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.282134 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.282315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.282440 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.282624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.282748 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.282928 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.283163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.283371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.283523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.283685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.283980 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.284114 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.284306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.284431 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.284620 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.284738 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.284932 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.285063 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.285728 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.285828 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.285923 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286017 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286199 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286548 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286769 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.286871 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.287113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.287210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.287429 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.287585 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.287745 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.287848 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.288061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.288153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.288375 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.288521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.288687 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.288932 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.289025 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.289268 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.289360 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.289590 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.289694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.289921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.290015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.290240 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.290343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.290547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.290639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.290853 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.290976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.291184 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.291322 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.291513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.291650 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.291826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.291978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.292139 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.292325 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.292450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.292606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.292765 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.292931 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.293077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.293248 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.293389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.293578 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.293700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.293894 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.293996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.294232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.294333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.294579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.294680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.294902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.295010 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.295241 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.295371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.295548 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.295678 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.295855 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.295948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.296159 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.296258 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.296471 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.296572 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.296794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.296896 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.297107 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.297208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.297414 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.297515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.297723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.297826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.298032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.298132 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.298338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.298437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.298665 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.298837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.298979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.299121 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.299310 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.299643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.299776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.300014 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.300108 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.300333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.300425 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.300644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.300738 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.300962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.301062 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.301269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.301372 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.301576 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.301678 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.301885 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.302001 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.302194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.302301 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.302505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.302629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.302814 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.302957 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.303143 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.303322 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.303450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.303648 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.303787 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.303964 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.304128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.304296 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.304446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.304645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.304773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.304975 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.305076 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.305307 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.305438 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.305614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.305739 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.305921 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.306024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.306226 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.306320 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.306536 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.306636 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.306857 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.306959 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.307196 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.307303 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.307505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.307599 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.307814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.307923 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.308125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.308217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.308432 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.308525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.308737 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.308844 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.309043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.309146 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.309348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.309442 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.309657 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.309750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.309962 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.310055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.310267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.310369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.310570 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.310665 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.310876 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.310977 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.311218 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.311313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.311523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.311619 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.311829 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.311930 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.312136 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.312240 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.312444 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.312538 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.312751 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.312844 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.313055 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.313156 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.313357 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.313459 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.313675 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.313775 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.313992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.314104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.314389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.314484 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.314863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.314963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.315273 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.315369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.315606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.315695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.315919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.316021 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.316244 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.316344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.316570 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.316663 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.316888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.316984 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.317201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.317301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.317534 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.317616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.317862 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.318025 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.318176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.318281 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.318453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.318582 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.318765 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.318873 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.319098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.319196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.319389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 04:05:38.319505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.319761 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.320092 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.320399 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.320796 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.321125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.321479 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.321798 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.322115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.322447 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.322763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.323105 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.323421 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.323736 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.324050 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.324370 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.324686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.324999 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.325317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.325634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.325962 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.326288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.326600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.326925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.327274 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.327623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.327939 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.328282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.328610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.328925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.329238 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.329547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:05:38.329795 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 04:05:38.381835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Registered counter for database nova_api Aug 31 04:05:38.392223 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO dbcounter [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Registered counter for database nova_api Aug 31 04:05:38.403307 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:05:38.410398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:05:38.413200 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_db.sqlalchemy.engines [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:05:38.419838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writer thread running {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:05:38.467155 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.context [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d(cell1) {{(pid=120662) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 04:05:38.471435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:05:38.471927 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:05:38.473526 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:05:38.474237 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:05:38.475020 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:05:38.476635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.context [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d(cell1) {{(pid=120661) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 04:05:38.477088 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:05:38.479151 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Registered counter for database nova_cell0 Aug 31 04:05:38.480667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:05:38.481144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:05:38.482738 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:05:38.483260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Registered counter for database nova_cell1 Aug 31 04:05:38.483491 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:05:38.483961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:05:38.485955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:05:38.488483 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO dbcounter [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Registered counter for database nova_cell0 Aug 31 04:05:38.491991 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:05:38.492809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:05:38.493109 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO dbcounter [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Registered counter for database nova_cell1 Aug 31 04:05:38.500120 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:05:38.501588 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:05:38.502254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_db.sqlalchemy.engines [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:05:38.503578 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_db.sqlalchemy.engines [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:05:38.510279 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writer thread running {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:05:38.511622 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writer thread running {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:05:38.649876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Registered counter for database nova_cell0 Aug 31 04:05:38.657115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:05:38.662083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO dbcounter [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Registered counter for database nova_cell0 Aug 31 04:05:38.662847 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:05:38.669654 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_db.sqlalchemy.engines [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:05:38.675881 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writer thread running {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:05:38.983596 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:05:38.991867 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:05:39.000831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: WARNING keystonemiddleware.auth_token [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:05:39.008669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: WARNING keystonemiddleware.auth_token [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:05:39.344679 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:05:39.350918 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-5a37f338-a6e2-43f9-8660-bf3042a40d9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:05:39.356289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c95c3399c0 pid: 120662 (default app) Aug 31 04:05:39.359425 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: WARNING keystonemiddleware.auth_token [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 04:05:39.366536 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: WARNING keystonemiddleware.auth_token [None req-53f83689-cdff-44ae-981c-196c57b1ccb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 04:05:39.371930 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c95c3399c0 pid: 120661 (default app) Aug 31 04:06:13.721674 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:13.723163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:13.723844 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:13.724754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:14.947853 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b137958-350e-4ede-b848-947fd7e16c59 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Action: 'create', calling method: .version_select at 0x7f88ae344e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-912752032", "metadata": {"Type": "work"}}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:15.230377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:15.231214 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:15.232107 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:15.232812 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e39a4cef-e260-4ada-987f-9637ff25dc97 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Action: 'create', calling method: .version_select at 0x7f88ae343e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2089371767", "metadata": {"Type": "work"}}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e39a4cef-e260-4ada-987f-9637ff25dc97 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Request method failure captured: Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 122 Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt43HqXjGGPBQopVqKwZSmhsI-bYqXFOTAHhb_SOIVufYPT5POhzrc-GxxCcaxLY232PBZblK0_JdYURRrd_rKIAZstqlnNqFRmVwuWLOTZ_RnkFUFen5PQOMncW87KchEQRRN80_0ujUJioXwHdF6WiD_IkhrvZZV9957xusLaOPFM Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:06:16.731374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af1f38c50c24416910c2c459fba18ed", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 1a061fce2cbc40aeacf1d442f65f86c5 Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2089371767", "metadata": {"Type": "work"}}} Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: Aug 31 04:06:16.738183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2089371767', 'metadata': {'Type': 'work'}}}} Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise error Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:16.743635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 04:06:16.746010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 04:06:16.747727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 04:06:16.747727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:16.747727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e39a4cef-e260-4ada-987f-9637ff25dc97 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:16.747727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e39a4cef-e260-4ada-987f-9637ff25dc97 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.522718 Aug 31 04:06:16.747727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 31 04:06:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1530 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:06:17.072412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-51761f32-1af0-4442-9757-4ff61ed1834d tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Action: 'create', calling method: .version_select at 0x7f88ae2925e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1132439958"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:17.084690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0b137958-350e-4ede-b848-947fd7e16c59 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.378307 Aug 31 04:06:17.094096 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 1/2] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 31 04:06:13 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3381 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 04:06:17.094096 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1267347b-7936-4ffe-8169-b954bf5b9c37 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Action: 'create', calling method: .version_select at 0x7f88ae1cac10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-866013860", "metadata": {"Type": "work"}}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1267347b-7936-4ffe-8169-b954bf5b9c37 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Request method failure captured: Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 119 Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt43HqXjGGPBQopVqKwZSmhsI-bYqXFOTAHhb_SOIVufYPT5POhzrc-GxxCcaxLY232PBZblK0_JdYURRrd_rKIAZstqlnNqFRmVwuWLOTZ_RnkFUFen5PQOMncW87KchEQRRN80_0ujUJioXwHdF6WiD_IkhrvZZV9957xusLaOPFM Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:06:17.100994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af1f38c50c24416910c2c459fba18ed", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 1a061fce2cbc40aeacf1d442f65f86c5 Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-866013860", "metadata": {"Type": "work"}}} Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: Aug 31 04:06:17.102473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-866013860', 'metadata': {'Type': 'work'}}}} Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise error Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi '0' Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:17.103445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 04:06:17.104976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 04:06:17.106184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 04:06:17.106184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.106184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1267347b-7936-4ffe-8169-b954bf5b9c37 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:17.106184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1267347b-7936-4ffe-8169-b954bf5b9c37 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015754 Aug 31 04:06:17.125215 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 31 04:06:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:06:17.131611 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7accee95-70cb-4ec7-ba58-65c395255df3 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Calling method '.version_select at 0x7f88ae19a670>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:17.244083 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7accee95-70cb-4ec7-ba58-65c395255df3 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29" status: 200 len: 352 microversion: 2.1 time: 0.117311 Aug 31 04:06:17.250190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:17 2022] GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:17.250190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0f5a06a-ea99-44b0-a8cc-1c02fca8fd23 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Action: 'create', calling method: .version_select at 0x7f88ae1de430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1615334624", "metadata": {"Type": "work"}}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0f5a06a-ea99-44b0-a8cc-1c02fca8fd23 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Request method failure captured: Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 119 Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt43HqXjGGPBQopVqKwZSmhsI-bYqXFOTAHhb_SOIVufYPT5POhzrc-GxxCcaxLY232PBZblK0_JdYURRrd_rKIAZstqlnNqFRmVwuWLOTZ_RnkFUFen5PQOMncW87KchEQRRN80_0ujUJioXwHdF6WiD_IkhrvZZV9957xusLaOPFM Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:06:17.253733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af1f38c50c24416910c2c459fba18ed", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 1a061fce2cbc40aeacf1d442f65f86c5 Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1615334624", "metadata": {"Type": "work"}}} Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: Aug 31 04:06:17.255296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1615334624', 'metadata': {'Type': 'work'}}}} Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise error Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi '' Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:17.262234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 04:06:17.263714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 04:06:17.264909 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 04:06:17.264909 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.264909 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0f5a06a-ea99-44b0-a8cc-1c02fca8fd23 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:17.264909 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0f5a06a-ea99-44b0-a8cc-1c02fca8fd23 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009212 Aug 31 04:06:17.264909 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 4/5] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 31 04:06:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:06:17.288399 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-012e70c7-5149-4bdc-bdff-09739f6bfd44 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Calling method '.version_select at 0x7f88ae19a8b0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:17.468409 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-012e70c7-5149-4bdc-bdff-09739f6bfd44 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] HTTP exception thrown: Volume tempest-invalid-1708213910 could not be found. Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-012e70c7-5149-4bdc-bdff-09739f6bfd44 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Request method failure captured: Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1708213910 HTTP/1.1 Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt43HqXjGGPBQopVqKwZSmhsI-bYqXFOTAHhb_SOIVufYPT5POhzrc-GxxCcaxLY232PBZblK0_JdYURRrd_rKIAZstqlnNqFRmVwuWLOTZ_RnkFUFen5PQOMncW87KchEQRRN80_0ujUJioXwHdF6WiD_IkhrvZZV9957xusLaOPFM Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:06:17.474478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af1f38c50c24416910c2c459fba18ed", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 1a061fce2cbc40aeacf1d442f65f86c5 Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Volume tempest-invalid-1708213910 could not be found. Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'tempest-invalid-1708213910'} Aug 31 04:06:17.476928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1708213910 could not be found. (HTTP 404) (Request-ID: req-53417414-e491-4447-a45c-dac9479dc632) Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.477906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:06:17.479116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1708213910 could not be found. Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:06:17.480232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1708213910 could not be found. Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1708213910 could not be found. Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-012e70c7-5149-4bdc-bdff-09739f6bfd44 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Returning 404 to user: Volume tempest-invalid-1708213910 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-012e70c7-5149-4bdc-bdff-09739f6bfd44 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1708213910" status: 404 len: 99 microversion: 2.1 time: 0.211330 Aug 31 04:06:17.481344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 5/6] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 31 04:06:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1708213910 => generated 99 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 04:06:17.508832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6efe9dd7-58ac-4780-8c82-0527e598f260 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017668 Aug 31 04:06:17.509723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 6/7] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Aug 31 04:06:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 04:06:17.520269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cff2be95-7fb4-479d-90a4-22dc29937773 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004047 Aug 31 04:06:17.521856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 7/8] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Aug 31 04:06:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 04:06:17.532033 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15fd5e28-77e8-4efe-82eb-80e13b62c5c0 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Calling method '.version_select at 0x7f88ae19adc0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:17.582699 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-15fd5e28-77e8-4efe-82eb-80e13b62c5c0 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] HTTP exception thrown: Volume 7fecf051-363a-414a-a95d-1d222ab5d3f0 could not be found. Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15fd5e28-77e8-4efe-82eb-80e13b62c5c0 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Request method failure captured: Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/os-volumes/7fecf051-363a-414a-a95d-1d222ab5d3f0 HTTP/1.1 Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt43HqXjGGPBQopVqKwZSmhsI-bYqXFOTAHhb_SOIVufYPT5POhzrc-GxxCcaxLY232PBZblK0_JdYURRrd_rKIAZstqlnNqFRmVwuWLOTZ_RnkFUFen5PQOMncW87KchEQRRN80_0ujUJioXwHdF6WiD_IkhrvZZV9957xusLaOPFM Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:06:17.585323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af1f38c50c24416910c2c459fba18ed", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 1a061fce2cbc40aeacf1d442f65f86c5 Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Volume 7fecf051-363a-414a-a95d-1d222ab5d3f0 could not be found. Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '7fecf051-363a-414a-a95d-1d222ab5d3f0'} Aug 31 04:06:17.586698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7fecf051-363a-414a-a95d-1d222ab5d3f0 could not be found. (HTTP 404) (Request-ID: req-7e914d31-4a11-47d7-97c3-de67a6c611bf) Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.587487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:06:17.588701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7fecf051-363a-414a-a95d-1d222ab5d3f0 could not be found. Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 04:06:17.591504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7fecf051-363a-414a-a95d-1d222ab5d3f0 could not be found. Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7fecf051-363a-414a-a95d-1d222ab5d3f0 could not be found. Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15fd5e28-77e8-4efe-82eb-80e13b62c5c0 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Returning 404 to user: Volume 7fecf051-363a-414a-a95d-1d222ab5d3f0 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-15fd5e28-77e8-4efe-82eb-80e13b62c5c0 tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/7fecf051-363a-414a-a95d-1d222ab5d3f0" status: 404 len: 109 microversion: 2.1 time: 0.058759 Aug 31 04:06:17.592573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 8/9] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:06:17 2022] DELETE /compute/v2.1/os-volumes/7fecf051-363a-414a-a95d-1d222ab5d3f0 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:06:17.598325 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8f56de9-fb4d-484d-a254-ef8fcdad12ee tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Calling method '.version_select at 0x7f88ae19a3a0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:17.700131 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-d8f56de9-fb4d-484d-a254-ef8fcdad12ee tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] HTTP exception thrown: Volume 08c478ce-6897-45b7-93c6-875789593d30 could not be found. Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8f56de9-fb4d-484d-a254-ef8fcdad12ee tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Request method failure captured: Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/os-volumes/08c478ce-6897-45b7-93c6-875789593d30 HTTP/1.1 Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt43HqXjGGPBQopVqKwZSmhsI-bYqXFOTAHhb_SOIVufYPT5POhzrc-GxxCcaxLY232PBZblK0_JdYURRrd_rKIAZstqlnNqFRmVwuWLOTZ_RnkFUFen5PQOMncW87KchEQRRN80_0ujUJioXwHdF6WiD_IkhrvZZV9957xusLaOPFM Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:06:17.702055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af1f38c50c24416910c2c459fba18ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af1f38c50c24416910c2c459fba18ed", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 2af1f38c50c24416910c2c459fba18ed Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-1574005797 Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 1a061fce2cbc40aeacf1d442f65f86c5 Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-1574005797-project Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Volume 08c478ce-6897-45b7-93c6-875789593d30 could not be found. Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '08c478ce-6897-45b7-93c6-875789593d30'} Aug 31 04:06:17.703534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08c478ce-6897-45b7-93c6-875789593d30 could not be found. (HTTP 404) (Request-ID: req-9d6cf144-9ba0-45be-bcf1-0bee9e1dc9a4) Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.704374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:17.706774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08c478ce-6897-45b7-93c6-875789593d30 could not be found. Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 04:06:17.709313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08c478ce-6897-45b7-93c6-875789593d30 could not be found. Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08c478ce-6897-45b7-93c6-875789593d30 could not be found. Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8f56de9-fb4d-484d-a254-ef8fcdad12ee tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] Returning 404 to user: Volume 08c478ce-6897-45b7-93c6-875789593d30 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d8f56de9-fb4d-484d-a254-ef8fcdad12ee tempest-VolumesNegativeTest-1574005797 tempest-VolumesNegativeTest-1574005797-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/08c478ce-6897-45b7-93c6-875789593d30" status: 404 len: 109 microversion: 2.1 time: 0.110261 Aug 31 04:06:17.710423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 9/10] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:17 2022] GET /compute/v2.1/os-volumes/08c478ce-6897-45b7-93c6-875789593d30 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:06:17.936250 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-51761f32-1af0-4442-9757-4ff61ed1834d tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.188250 Aug 31 04:06:17.937171 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 2/11] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Aug 31 04:06:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1190 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 04:06:17.955445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fb510ad7-4d59-446f-8d58-ca09ff02d8d4 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae19a160>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:18.083742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fb510ad7-4d59-446f-8d58-ca09ff02d8d4 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a" status: 200 len: 345 microversion: 2.1 time: 0.136302 Aug 31 04:06:18.084771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 10/12] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:17 2022] GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:18.259640 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f1727614-6304-47f9-9256-8642ac80fe1a tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Calling method '.version_select at 0x7f88ae18e310>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:18.401300 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f1727614-6304-47f9-9256-8642ac80fe1a tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29" status: 200 len: 353 microversion: 2.1 time: 0.147004 Aug 31 04:06:18.401876 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 3/13] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:18 2022] GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:18.418816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d72992f-ae5b-41c4-8020-e23f0143b51b tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Calling method '.version_select at 0x7f88ae0f18b0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:18.550067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d72992f-ae5b-41c4-8020-e23f0143b51b tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29" status: 200 len: 353 microversion: 2.1 time: 0.139139 Aug 31 04:06:18.563210 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 11/14] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:18 2022] GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:18.569591 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f86a9a02-e9c8-4e91-ab7a-9af10399fa5b tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Calling method '.version_select at 0x7f88ae18ea60>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:18.710417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f86a9a02-e9c8-4e91-ab7a-9af10399fa5b tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29" status: 202 len: 0 microversion: 2.1 time: 0.145048 Aug 31 04:06:18.713847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 4/15] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:06:18 2022] DELETE /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:06:18.719274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad218c4a-05ed-4f9a-ae2b-d6ccdb07111f tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Calling method '.version_select at 0x7f88ae19a160>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:18.824376 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad218c4a-05ed-4f9a-ae2b-d6ccdb07111f tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29" status: 200 len: 352 microversion: 2.1 time: 0.108708 Aug 31 04:06:18.833455 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 12/16] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:18 2022] GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:19.098904 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9ac84dab-5eb1-4207-ad45-833a8df3029c tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae18eb80>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:19.220941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9ac84dab-5eb1-4207-ad45-833a8df3029c tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a" status: 200 len: 346 microversion: 2.1 time: 0.126572 Aug 31 04:06:19.221867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 5/17] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:19 2022] GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a => generated 346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:19.239424 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-70169725-6f08-490e-8fa3-1427b24241ea tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Action: 'create', calling method: .version_select at 0x7f88ae19a700>, body: {"snapshot": {"volume_id": "f7522708-41ab-4873-a178-60c6ce97cb5a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1585584875"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:19.747334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-70169725-6f08-490e-8fa3-1427b24241ea tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.512664 Aug 31 04:06:19.753377 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 13/18] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Aug 31 04:06:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:19.758572 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3d850976-b3ba-4baf-a0d9-66c5cc0474ac tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae18e550>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:19.842152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d6bc310d-737d-4743-8240-a5ab3c2ca722 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Calling method '.version_select at 0x7f88ae0f1dc0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:19.906321 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-d6bc310d-737d-4743-8240-a5ab3c2ca722 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] HTTP exception thrown: Volume d2a2404e-609b-46f8-8f20-9c723477ae29 could not be found. Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d6bc310d-737d-4743-8240-a5ab3c2ca722 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Request method failure captured: Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29 HTTP/1.1 Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt41KS_HuSBthwNq2aOwE4PEuvcde5-va9WO9Tk7rReMVPy8kDr2Ls_DSr1xDHVJC1a1sKTIhhvnwXG8voQsdzVhRRWp9z0viCI8VRT1jMY6BoHmPDCZsOUwN_BglX28KXoRBQ_joJrnmFQC5J8j8k2m1KSIO4j_28fNSdXMscy0Uis Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 985d43160bda4a45a77225f3387adb2f Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesGetTestJSON-527926855 Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:06:19.908925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/985d43160bda4a45a77225f3387adb2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/985d43160bda4a45a77225f3387adb2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/985d43160bda4a45a77225f3387adb2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_985d43160bda4a45a77225f3387adb2f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesGetTestJSON-527926855 Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 985d43160bda4a45a77225f3387adb2f Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesGetTestJSON-527926855 Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesGetTestJSON-527926855-project Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 722e6b0dd66541bcbeaeeebd5a02bec4 Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesGetTestJSON-527926855-project Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Volume d2a2404e-609b-46f8-8f20-9c723477ae29 could not be found. Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'd2a2404e-609b-46f8-8f20-9c723477ae29'} Aug 31 04:06:19.910024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2a2404e-609b-46f8-8f20-9c723477ae29 could not be found. (HTTP 404) (Request-ID: req-90e055db-774a-499d-9d2d-0c9bf57a0287) Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:19.910882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:19.912126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2a2404e-609b-46f8-8f20-9c723477ae29 could not be found. Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 04:06:19.913074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2a2404e-609b-46f8-8f20-9c723477ae29 could not be found. Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2a2404e-609b-46f8-8f20-9c723477ae29 could not be found. Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d6bc310d-737d-4743-8240-a5ab3c2ca722 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] Returning 404 to user: Volume d2a2404e-609b-46f8-8f20-9c723477ae29 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d6bc310d-737d-4743-8240-a5ab3c2ca722 tempest-VolumesGetTestJSON-527926855 tempest-VolumesGetTestJSON-527926855-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29" status: 404 len: 109 microversion: 2.1 time: 0.073609 Aug 31 04:06:19.914606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 14/19] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:19 2022] GET /compute/v2.1/os-volumes/d2a2404e-609b-46f8-8f20-9c723477ae29 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:06:20.078405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3d850976-b3ba-4baf-a0d9-66c5cc0474ac tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be" status: 200 len: 287 microversion: 2.1 time: 0.323638 Aug 31 04:06:20.079759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 6/20] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 31 04:06:19 2022] GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be => generated 287 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:20.094069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d9fd07a-1cbe-411d-a5f4-c79d859822bb tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae0f1670>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:20.169369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d9fd07a-1cbe-411d-a5f4-c79d859822bb tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.083131 Aug 31 04:06:20.170442 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 15/21] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Aug 31 04:06:20 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:20.185781 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6e59a844-5888-4bc4-8b12-d97769eaab2f tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae1a01f0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:20.241231 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6e59a844-5888-4bc4-8b12-d97769eaab2f tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be" status: 200 len: 287 microversion: 2.1 time: 0.063043 Aug 31 04:06:20.242061 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 7/22] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 31 04:06:20 2022] GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:21.255826 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7ddb9e2c-9885-4fc4-af53-ffc32e9ab0d9 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae19a5e0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:21.314923 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7ddb9e2c-9885-4fc4-af53-ffc32e9ab0d9 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be" status: 200 len: 287 microversion: 2.1 time: 0.064094 Aug 31 04:06:21.315527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 16/23] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 31 04:06:21 2022] GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:22.326508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4e8e1810-66fd-416a-919a-86db63f35dd2 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae18e1f0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:22.412918 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4e8e1810-66fd-416a-919a-86db63f35dd2 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be" status: 200 len: 287 microversion: 2.1 time: 0.090043 Aug 31 04:06:22.418486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 8/24] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 31 04:06:22 2022] GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:23.426605 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c42e6dde-7284-4ed3-95b6-140e300267bc tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae19a1f0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:23.520477 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c42e6dde-7284-4ed3-95b6-140e300267bc tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be" status: 200 len: 288 microversion: 2.1 time: 0.098437 Aug 31 04:06:23.521063 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 17/25] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 31 04:06:23 2022] GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be => generated 288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:23.532619 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-89f5f875-60e0-40bd-8c27-85dee8ea5a47 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae18e940>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:23.688463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-89f5f875-60e0-40bd-8c27-85dee8ea5a47 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be" status: 202 len: 0 microversion: 2.1 time: 0.159241 Aug 31 04:06:23.690124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 9/26] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Aug 31 04:06:23 2022] DELETE /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:06:23.699016 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5067cdca-3d54-4327-b1be-7424e18bf9db tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae19adc0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:23.781484 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5067cdca-3d54-4327-b1be-7424e18bf9db tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be" status: 200 len: 287 microversion: 2.1 time: 0.086537 Aug 31 04:06:23.782495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 18/27] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 31 04:06:23 2022] GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:24.795010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-93fc9642-1c3d-4e62-a857-dc4ce45ce687 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae1a04c0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:24.858643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-93fc9642-1c3d-4e62-a857-dc4ce45ce687 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] HTTP exception thrown: Snapshot a06c072f-d8a3-4f56-9711-4ab2655895be could not be found. Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-93fc9642-1c3d-4e62-a857-dc4ce45ce687 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Request method failure captured: Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be HTTP/1.1 Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt43KYI9aS4L5LRLEkzMiW7US0m1MGge9Wcb2ZOmB7L6CqR_9vt6RgZmZDxkUiL6Byp3Q2DE7diefTUPmozQ2bZfTnrFuVg1ICLm5A9aHmwsqDwx-NSx6TdUBsLme_ww5-iZ84Yk-npdabfKTDEAa2rScUS1BF96zuSp56My8Ph6hUA Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: 53dee0538d6744a3983ccd114dcc6de4 Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:06:24.863686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53dee0538d6744a3983ccd114dcc6de4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: 53dee0538d6744a3983ccd114dcc6de4 Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-VolumesSnapshotsTestJSON-1138877960-project Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 85aba434ffdc44a191f55c4881f13327 Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1138877960-project Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Snapshot a06c072f-d8a3-4f56-9711-4ab2655895be could not be found. Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': 'a06c072f-d8a3-4f56-9711-4ab2655895be'} Aug 31 04:06:24.865289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a06c072f-d8a3-4f56-9711-4ab2655895be could not be found. (HTTP 404) (Request-ID: req-1c504825-c6dc-4231-a54c-6244f6d600e2) Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:24.866063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:24.867020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a06c072f-d8a3-4f56-9711-4ab2655895be could not be found. Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 04:06:24.868103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a06c072f-d8a3-4f56-9711-4ab2655895be could not be found. Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a06c072f-d8a3-4f56-9711-4ab2655895be could not be found. Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-93fc9642-1c3d-4e62-a857-dc4ce45ce687 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Returning 404 to user: Snapshot a06c072f-d8a3-4f56-9711-4ab2655895be could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:24.869091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-93fc9642-1c3d-4e62-a857-dc4ce45ce687 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be" status: 404 len: 111 microversion: 2.1 time: 0.075211 Aug 31 04:06:24.869848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 10/28] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 31 04:06:24 2022] GET /compute/v2.1/os-snapshots/a06c072f-d8a3-4f56-9711-4ab2655895be => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:06:24.875195 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-212751a1-7f54-4ee3-a6fb-811a34f296d4 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae0f1550>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:25.001659 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-212751a1-7f54-4ee3-a6fb-811a34f296d4 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a" status: 202 len: 0 microversion: 2.1 time: 0.130907 Aug 31 04:06:25.010775 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 19/29] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:06:24 2022] DELETE /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:06:25.014458 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-861f7d8b-bb67-42c9-ae66-5a94433bdaf0 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae1a0b80>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:25.116925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-861f7d8b-bb67-42c9-ae66-5a94433bdaf0 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a" status: 200 len: 345 microversion: 2.1 time: 0.108536 Aug 31 04:06:25.124319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 11/30] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:25 2022] GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:26.132177 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-76a37a2d-5caf-4e0a-bb59-e7b9858df1d3 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae0f1940>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:26.190029 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-76a37a2d-5caf-4e0a-bb59-e7b9858df1d3 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] HTTP exception thrown: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-76a37a2d-5caf-4e0a-bb59-e7b9858df1d3 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Request method failure captured: Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a HTTP/1.1 Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt43KYI9aS4L5LRLEkzMiW7US0m1MGge9Wcb2ZOmB7L6CqR_9vt6RgZmZDxkUiL6Byp3Q2DE7diefTUPmozQ2bZfTnrFuVg1ICLm5A9aHmwsqDwx-NSx6TdUBsLme_ww5-iZ84Yk-npdabfKTDEAa2rScUS1BF96zuSp56My8Ph6hUA Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 53dee0538d6744a3983ccd114dcc6de4 Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:06:26.191989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53dee0538d6744a3983ccd114dcc6de4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 53dee0538d6744a3983ccd114dcc6de4 Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesSnapshotsTestJSON-1138877960-project Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 85aba434ffdc44a191f55c4881f13327 Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1138877960-project Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'f7522708-41ab-4873-a178-60c6ce97cb5a'} Aug 31 04:06:26.192981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. (HTTP 404) (Request-ID: req-a0b2aa4b-1058-452c-aee3-43aefcc9369b) Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.193598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:26.194446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 04:06:26.197272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-76a37a2d-5caf-4e0a-bb59-e7b9858df1d3 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Returning 404 to user: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:26.198117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-76a37a2d-5caf-4e0a-bb59-e7b9858df1d3 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a" status: 404 len: 109 microversion: 2.1 time: 0.064986 Aug 31 04:06:26.207778 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-59a17a55-604e-4939-bfbb-1c4eb47fae13 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae0f0280>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:26.211378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 20/31] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:26 2022] GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:06:26.251251 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-59a17a55-604e-4939-bfbb-1c4eb47fae13 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] HTTP exception thrown: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-59a17a55-604e-4939-bfbb-1c4eb47fae13 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Request method failure captured: Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: DELETE /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a HTTP/1.1 Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt43KYI9aS4L5LRLEkzMiW7US0m1MGge9Wcb2ZOmB7L6CqR_9vt6RgZmZDxkUiL6Byp3Q2DE7diefTUPmozQ2bZfTnrFuVg1ICLm5A9aHmwsqDwx-NSx6TdUBsLme_ww5-iZ84Yk-npdabfKTDEAa2rScUS1BF96zuSp56My8Ph6hUA Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: 53dee0538d6744a3983ccd114dcc6de4 Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:06:26.253403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53dee0538d6744a3983ccd114dcc6de4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: 53dee0538d6744a3983ccd114dcc6de4 Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-VolumesSnapshotsTestJSON-1138877960-project Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 85aba434ffdc44a191f55c4881f13327 Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1138877960-project Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': 'f7522708-41ab-4873-a178-60c6ce97cb5a'} Aug 31 04:06:26.254567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. (HTTP 404) (Request-ID: req-4a391cb4-5a69-45f3-8a5e-c96068f075c1) Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.255891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 04:06:26.256945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 04:06:26.257947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-59a17a55-604e-4939-bfbb-1c4eb47fae13 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Returning 404 to user: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:26.258848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-59a17a55-604e-4939-bfbb-1c4eb47fae13 tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a" status: 404 len: 109 microversion: 2.1 time: 0.051188 Aug 31 04:06:26.263227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-65bbccf7-587b-45f8-91e3-11ec07ad8bde tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Calling method '.version_select at 0x7f88ae19aee0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:26.267380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 12/32] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:06:26 2022] DELETE /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:06:26.364290 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-65bbccf7-587b-45f8-91e3-11ec07ad8bde tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] HTTP exception thrown: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-65bbccf7-587b-45f8-91e3-11ec07ad8bde tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Request method failure captured: Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a HTTP/1.1 Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt43KYI9aS4L5LRLEkzMiW7US0m1MGge9Wcb2ZOmB7L6CqR_9vt6RgZmZDxkUiL6Byp3Q2DE7diefTUPmozQ2bZfTnrFuVg1ICLm5A9aHmwsqDwx-NSx6TdUBsLme_ww5-iZ84Yk-npdabfKTDEAa2rScUS1BF96zuSp56My8Ph6hUA Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 53dee0538d6744a3983ccd114dcc6de4 Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:06:26.366727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dee0538d6744a3983ccd114dcc6de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53dee0538d6744a3983ccd114dcc6de4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 53dee0538d6744a3983ccd114dcc6de4 Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1138877960 Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesSnapshotsTestJSON-1138877960-project Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 85aba434ffdc44a191f55c4881f13327 Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1138877960-project Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'f7522708-41ab-4873-a178-60c6ce97cb5a'} Aug 31 04:06:26.367897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. (HTTP 404) (Request-ID: req-b6e0ed54-5e2f-4014-9b8b-1e83fc88de72) Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.368560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 04:06:26.369731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 04:06:26.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. Aug 31 04:06:26.371758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:06:26.373013 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-65bbccf7-587b-45f8-91e3-11ec07ad8bde tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] Returning 404 to user: Volume f7522708-41ab-4873-a178-60c6ce97cb5a could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:06:26.373973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-65bbccf7-587b-45f8-91e3-11ec07ad8bde tempest-VolumesSnapshotsTestJSON-1138877960 tempest-VolumesSnapshotsTestJSON-1138877960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a" status: 404 len: 109 microversion: 2.1 time: 0.114604 Aug 31 04:06:26.378024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 21/33] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:06:26 2022] GET /compute/v2.1/os-volumes/f7522708-41ab-4873-a178-60c6ce97cb5a => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:06:28.442232 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1826213511", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "networks": [{"uuid": "baa3571f-8f19-4b2e-8020-5b4000efc9ca"}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:28.558273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bc014dfd-f4d9-491e-88d4-b0069a5db731 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'create', calling method: .version_select at 0x7f88ae19a700>, body: {"keypair": {"name": "tempest-keypair-2123751580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4qOzuIiDEuejets7heQvGQz5tZwWcrDV/puPRM/z9hELijhd2kpobdIJdgHQAdgu/6dvIsdoHYGoU2GyR936jYicqMoRf+lZSBmvU/ZLaV2Ssxw3B5XwY0oTM2ZbWb9A=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:28.644607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] validate_networks() for [('baa3571f-8f19-4b2e-8020-5b4000efc9ca', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:06:28.690583 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-bc014dfd-f4d9-491e-88d4-b0069a5db731 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Getting quotas for project 66bcbde4eda6417ea15dca2371c28540. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:06:28.714362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-bc014dfd-f4d9-491e-88d4-b0069a5db731 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Getting quotas for user 956b08da3ba944d382877cf266389127 and project 66bcbde4eda6417ea15dca2371c28540. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:06:28.848639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bc014dfd-f4d9-491e-88d4-b0069a5db731 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.517566 Aug 31 04:06:28.860709 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 22/34] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Aug 31 04:06:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 531 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 31 04:06:31.323116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:06:31.324700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:06:31.325681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:06:31.326385 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:06:31.327067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:06:31.364030 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:31.365216 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:31.365877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:31.367100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:31.367800 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:31.368411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:31.412399 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Getting quotas for project dfea8632ec6f4cb5ac84e58d4fe10e6a. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:06:31.423463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Getting quotas for user 7103b8b46630401889a8e040c0e9ad62 and project dfea8632ec6f4cb5ac84e58d4fe10e6a. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:06:31.440729 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:06:31.444602 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:06:31.572571 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-06b99ccc-aa4f-4485-aff9-8e359cca8e1a tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.499194 Aug 31 04:06:31.581809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 13/35] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:06:31.591553 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2f6ac6f2-4b53-453f-b0a8-5d495ebdc57b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:31.592322 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2f6ac6f2-4b53-453f-b0a8-5d495ebdc57b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:32.049507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2f6ac6f2-4b53-453f-b0a8-5d495ebdc57b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:32.101210 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2f6ac6f2-4b53-453f-b0a8-5d495ebdc57b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1215 microversion: 2.1 time: 0.511469 Aug 31 04:06:32.101882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 23/36] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:31 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1215 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:06:33.126576 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-80b5446f-aaaf-4b06-9bfa-71951b622170 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:33.127550 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-80b5446f-aaaf-4b06-9bfa-71951b622170 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:33.390709 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-80b5446f-aaaf-4b06-9bfa-71951b622170 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:33.445890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-80b5446f-aaaf-4b06-9bfa-71951b622170 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1215 microversion: 2.1 time: 0.324403 Aug 31 04:06:33.451383 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 14/37] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:33 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:34.475476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:34.477546 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:34.493350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:34.496708 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:34.498470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:34.506252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:34.507127 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:34.513305 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:34.877076 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:34.896444 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7869f97e-6fbb-45bf-80cf-f2a8feb4a1ab tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1219 microversion: 2.1 time: 0.424714 Aug 31 04:06:34.901138 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 24/38] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:34 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1219 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:35.922594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:35.923375 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:35.931567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:35.932212 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:35.932770 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:35.933576 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:35.935530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:35.936071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:36.093027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:36.110175 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-986c5be8-43dd-4d6f-ae7d-9fa608f2b3b0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1267 microversion: 2.1 time: 0.190786 Aug 31 04:06:36.112152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 25/39] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:35 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:36.263203 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-153417984", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52829969-a42a-442d-a4b2-1b1707d47a14"}], "security_groups": [{"name": "tempest-securitygroup--392913172"}], "key_name": "tempest-keypair-2123751580", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:36.525523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e7848882-846e-492f-bf6c-9aa744f96631 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: .version_select at 0x7f88ad8054c0>, body: {"keypair": {"name": "tempest-keypair-2054636436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOfLMql2hrIDsdoPt0xpufqdlwhyuxMk7TMUW7O6Q4w4oKp0HlI5xD7Q6X5amCo1uOB8reraWkwr2tyhkz4YJu0ZMSEyeV/iK6uA0r2o6IjsqRNM2IPoOFKY8rCiGmjAw=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:36.617930 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-e7848882-846e-492f-bf6c-9aa744f96631 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:06:36.628267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-e7848882-846e-492f-bf6c-9aa744f96631 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for user f80c8c1d6af7450eb8f936df231ad63b and project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:06:36.727477 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e7848882-846e-492f-bf6c-9aa744f96631 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.240837 Aug 31 04:06:36.735449 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 15/40] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:06:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:36.916654 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1713955266", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:37.085992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] validate_networks() for [('52829969-a42a-442d-a4b2-1b1707d47a14', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:06:37.093322 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] validate_networks() for [('4b3892f5-0e7b-4fb7-bd9d-bcb974c2220e', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:06:40.668692 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:06:40.669277 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:06:40.669783 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:06:40.670317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:06:40.670837 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:06:40.690361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:40.690361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:40.690361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:40.697414 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:40.697959 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:40.702407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:40.765503 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Getting quotas for project 490f695240294bbaa99f5eaa1e32b977. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:06:40.772455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Getting quotas for user 77fb76da34bf44a1b214a08bb4b8e51b and project 490f695240294bbaa99f5eaa1e32b977. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:06:40.808022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:06:40.812403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:06:40.879328 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-adc2ad7a-add0-46f4-a337-b70d6c16fcfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.146885 Aug 31 04:06:40.885840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 16/41] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:06:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 4151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:06:40.893356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:40.894379 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:40.905341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:40.907104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:40.907850 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:40.911759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:40.912455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:40.914633 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:41.497279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:06:41.497855 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:06:41.498342 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:06:41.498814 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:06:41.500397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:06:41.532631 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:41.533325 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:41.533976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:41.537387 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:41.538180 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:41.541600 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:41.617882 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:41.622870 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Getting quotas for project 66bcbde4eda6417ea15dca2371c28540. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:06:41.635924 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Getting quotas for user 956b08da3ba944d382877cf266389127 and project 66bcbde4eda6417ea15dca2371c28540. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:06:41.657508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ef160c73-6680-4a9f-b5d9-9f66d4a4a238 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.763337 Aug 31 04:06:41.667405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:06:41.672159 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:06:41.674743 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 17/42] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:40 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:41.688233 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-444742a8-dd1d-4ee9-bab0-02b10f57bb9e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:41.690011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-444742a8-dd1d-4ee9-bab0-02b10f57bb9e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:41.782882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c9e61515-6f95-4872-8fba-00e1513e0480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.525135 Aug 31 04:06:41.788814 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 26/43] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Aug 31 04:06:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 5532 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 04:06:41.798649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1744821177", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df2a7da3-c61f-4600-a4d7-00eeb18098d5"}], "security_groups": [{"name": "tempest-securitygroup--749326756"}], "key_name": "tempest-keypair-2054636436", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:41.943561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-444742a8-dd1d-4ee9-bab0-02b10f57bb9e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:41.957040 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-444742a8-dd1d-4ee9-bab0-02b10f57bb9e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1222 microversion: 2.1 time: 0.280002 Aug 31 04:06:41.957840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 18/44] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:41 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1222 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:41.975399 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1f87efef-6a6c-427c-8d4d-8fc30a063a53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:41.978164 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1f87efef-6a6c-427c-8d4d-8fc30a063a53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:42.156113 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1f87efef-6a6c-427c-8d4d-8fc30a063a53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:42.189810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1f87efef-6a6c-427c-8d4d-8fc30a063a53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:42.201246 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1f87efef-6a6c-427c-8d4d-8fc30a063a53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:42.206818 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1f87efef-6a6c-427c-8d4d-8fc30a063a53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1281 microversion: 2.20 time: 0.241750 Aug 31 04:06:42.210477 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 19/45] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:41 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:42.229474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] validate_networks() for [('df2a7da3-c61f-4600-a4d7-00eeb18098d5', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:06:42.430660 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-281417570", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:42.573977 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] validate_networks() for [('4b3892f5-0e7b-4fb7-bd9d-bcb974c2220e', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:06:44.312670 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:06:44.313487 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:06:44.313810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:06:44.314384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:06:44.315177 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:06:44.339000 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:06:44.340670 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:06:44.341570 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:06:44.342309 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:06:44.343115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:06:44.351682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:44.356180 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:44.358354 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:44.359482 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:44.367243 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:44.367243 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:44.374327 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:44.375466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:44.376308 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:44.377568 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:44.378592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:44.379459 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:44.458483 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Getting quotas for project 490f695240294bbaa99f5eaa1e32b977. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:06:44.468499 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:06:44.477093 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for user f80c8c1d6af7450eb8f936df231ad63b and project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:06:44.482524 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Getting quotas for user 77fb76da34bf44a1b214a08bb4b8e51b and project 490f695240294bbaa99f5eaa1e32b977. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:06:44.526378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:06:44.529956 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:06:44.551705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:06:44.558453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:06:44.742955 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-aceffd94-ae7d-441f-8e4c-2e1e9ef6eb06 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.952315 Aug 31 04:06:44.748817 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 27/46] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:06:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:06:44.761098 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:44.774128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:44.782757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4f893549-62ba-4706-9ffe-2255bd46ecc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.357069 Aug 31 04:06:44.802353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 20/47] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:06:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:06:44.818611 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:44.819601 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:44.821214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:44.821981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:44.822573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:44.822987 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:44.830807 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:44.837906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:44.865078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:44.867103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:44.867781 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:44.871308 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:44.872081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:44.872734 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:45.776985 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:45.798440 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:45.801234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:45.810267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3016085d-350d-4d5a-b424-7f104022bd74 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1285 microversion: 2.20 time: 0.996931 Aug 31 04:06:45.811110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 21/48] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:44 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1285 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:45.840249 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-983f3245-9259-4ac7-ab97-6decb5542393 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:45.844736 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-983f3245-9259-4ac7-ab97-6decb5542393 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:46.587938 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-983f3245-9259-4ac7-ab97-6decb5542393 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:46.612284 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-983f3245-9259-4ac7-ab97-6decb5542393 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1242 microversion: 2.1 time: 0.796790 Aug 31 04:06:46.613333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 22/49] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:45 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1242 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:46.630743 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:46.631577 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:46.650644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:46.655557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:46.656282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:46.657163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:46.659686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:46.660310 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:46.754872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:46.798010 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-40eecf88-6496-4ef0-bba2-ee7d56617e07 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 2.034916 Aug 31 04:06:46.814409 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 28/50] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:44 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:46.840368 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:46.840981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:46.865694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:46.866268 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:46.866961 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:46.867946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:46.868443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:46.868869 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:47.049576 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:47.063821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-065d49bc-ad8c-469c-891f-754c8c99a5d0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1225 microversion: 2.1 time: 0.449236 Aug 31 04:06:47.064963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 23/51] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:46 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1225 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:47.112087 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:47.127738 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:47.129338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:47.130698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-abbe7172-b101-4625-988d-cc3ec4ded479 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1333 microversion: 2.20 time: 0.295286 Aug 31 04:06:47.163515 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 29/52] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:46 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1333 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:47.668407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:47.669047 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:47.703473 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:47.704226 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:47.704697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:47.707605 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:47.708072 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:47.708376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:47.822056 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:47.822676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:47.838873 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:47.839382 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:47.839549 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:47.841709 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:47.846650 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:47.849611 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:48.149718 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:48.177727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b3b2a495-3a95-4909-944e-e930c40b4c31 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1294 microversion: 2.1 time: 0.545845 Aug 31 04:06:48.182634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 24/53] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:47 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1294 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:48.197681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:48.200202 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:48.230510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:48.235820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:48.238541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:48.239903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:48.241376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:48.242175 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:48.346658 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:48.355706 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ce564a84-ec1e-44ef-be7a-a955aa16baeb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.537428 Aug 31 04:06:48.358601 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 30/54] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:47 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:48.364209 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:48.365241 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:48.371676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:48.372524 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:48.373161 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:48.374362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:48.375287 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:48.376148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:48.478081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:48.485848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9da02ef4-8b64-487a-ae37-ac8d4bb34a7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1273 microversion: 2.1 time: 0.300728 Aug 31 04:06:48.499368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 25/55] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:48 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:48.563503 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:48.577252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:48.580566 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:48.584462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-02dbebe1-183c-4bb7-9ec7-2f78d8af4ce2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1339 microversion: 2.20 time: 0.224474 Aug 31 04:06:48.586860 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 31/56] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:48 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:48.601598 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-0813d917-64a0-4205-b8f5-0f67c7e8f404 req-62a3c4c4-b98c-464d-b832-6caf00084edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5844439f-0f36-44bf-8d44-f7c95e7954c4", "tag": "c70b840e-d3e2-4644-b547-1b19ffa1be8d"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:48.619784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-0813d917-64a0-4205-b8f5-0f67c7e8f404 req-62a3c4c4-b98c-464d-b832-6caf00084edd service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:48.620270 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-0813d917-64a0-4205-b8f5-0f67c7e8f404 req-62a3c4c4-b98c-464d-b832-6caf00084edd service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:48.620754 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-0813d917-64a0-4205-b8f5-0f67c7e8f404 req-62a3c4c4-b98c-464d-b832-6caf00084edd service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:48.662454 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-0813d917-64a0-4205-b8f5-0f67c7e8f404 req-62a3c4c4-b98c-464d-b832-6caf00084edd service nova] Creating event network-changed:c70b840e-d3e2-4644-b547-1b19ffa1be8d for instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 on hv-cinder-85391 Aug 31 04:06:48.663320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-0813d917-64a0-4205-b8f5-0f67c7e8f404 req-62a3c4c4-b98c-464d-b832-6caf00084edd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 04:06:48.663960 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-0813d917-64a0-4205-b8f5-0f67c7e8f404 req-62a3c4c4-b98c-464d-b832-6caf00084edd service nova] Acquired lock "compute-rpcapi-router" {{(pid=120661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 04:06:48.665219 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:48.665976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:48.666608 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:48.667576 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:48.668244 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:48.670132 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:48.681031 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.compute.rpcapi [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 04:06:48.689989 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] Releasing lock "compute-rpcapi-router" {{(pid=120661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 04:06:48.718561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8e75dd9c-9ffb-45ce-a110-820cd9702551 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219849 Aug 31 04:06:48.719522 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 26/57] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:49.205385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:49.206586 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:49.213463 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:49.214157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:49.214740 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:49.220307 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:49.220860 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:49.221346 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:49.327202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:49.336189 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d3ceaebe-1542-4438-a1b3-089f691231d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1294 microversion: 2.1 time: 0.135467 Aug 31 04:06:49.350083 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 32/58] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:49 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:49.385867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:49.387214 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:49.414990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:49.415621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:49.416903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:49.417714 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:49.419128 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:49.420636 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:49.509139 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:49.509825 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:49.520434 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:49.524710 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:49.528147 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:49.532212 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:49.533679 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:49.538703 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:49.672925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:49.689529 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:49.689741 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-92b69878-cc57-4d21-8e47-80ba56ea4483 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1273 microversion: 2.1 time: 0.185396 Aug 31 04:06:49.690875 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 33/59] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:49 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:49.698991 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9c5f19fe-5cb9-4db1-ad70-95bef32e5f53 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.317954 Aug 31 04:06:49.699618 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:49.700567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:49.710284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:49.711283 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:49.711644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 27/60] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:49 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:49.712869 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:49.713911 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:49.714772 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:49.715435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:49.813529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:49.824288 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:49.826904 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:49.830348 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-918a8f3b-b109-4229-9129-321ab64bc296 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1339 microversion: 2.20 time: 0.134827 Aug 31 04:06:49.846216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 34/61] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:49 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1339 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:50.358602 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:50.359906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:50.367699 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:50.368887 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:50.369473 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:50.373366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:50.373366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:50.373366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:50.497049 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:50.516078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6d379294-21be-441d-9be9-cab31e58ce99 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1294 microversion: 2.1 time: 0.161900 Aug 31 04:06:50.516902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 28/62] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:50 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1294 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:50.719522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:50.719522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:50.720677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:50.721483 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:50.726325 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:50.727202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:50.727794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:50.728720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:50.729486 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:50.730204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:50.735592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:50.736366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:50.737008 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:50.740901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:50.743574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:50.744206 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:50.881856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:50.892095 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-50d4747f-ea7e-49ff-a8fe-123387fd3c10 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1273 microversion: 2.1 time: 0.182964 Aug 31 04:06:50.909402 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 35/63] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:50 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:50.914782 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:50.915748 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:50.924070 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:50.924827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:50.925367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:50.926164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:50.927275 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:50.927915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:51.050026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:51.062398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:51.065034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:51.066763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8ce38a32-3a2d-4ad9-b865-02a37134bfcd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1339 microversion: 2.20 time: 0.155861 Aug 31 04:06:51.068548 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 36/64] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:50 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:51.097467 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:51.125191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f4ae4e6a-b9a2-4244-8e48-ace6c25fc98b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.401155 Aug 31 04:06:51.144820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 29/65] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:50 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:51.538186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:51.538910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:51.546382 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:51.546868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:51.548287 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:51.548996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:51.549460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:51.549880 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:51.679466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:51.710015 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-53b98b63-ba9d-4257-9431-b0f6ea2029f1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1294 microversion: 2.1 time: 0.176780 Aug 31 04:06:51.713533 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 37/66] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:51 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1294 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:51.916191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:51.917125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:51.928834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:51.931741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:51.933369 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:51.936104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:51.938368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:51.940154 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:52.031497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:52.045020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ff03fb6f-a33b-46ce-a628-36171ae6261b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1273 microversion: 2.1 time: 0.132678 Aug 31 04:06:52.046747 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 30/67] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:51 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:52.097754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:52.099101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:52.115304 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:52.117058 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:52.119253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:52.121902 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:52.122391 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:52.124606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:52.146351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:52.147381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:52.160864 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:52.164174 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:52.168508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:52.171436 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:52.172094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:52.174342 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:52.319521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:52.332628 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:52.337406 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:52.340527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-220c9205-73cb-493b-a951-f7b5e9f4098a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1339 microversion: 2.20 time: 0.250298 Aug 31 04:06:52.371496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 38/68] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:52 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1339 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:52.501749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:52.511580 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-998abfac-f448-4ba0-8bd5-20531a3f66bd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.369060 Aug 31 04:06:52.513305 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 31/69] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:52 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:06:52.738053 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:52.740241 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:52.755306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:52.755858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:52.756306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:52.757034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:52.757490 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:52.757915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:52.954442 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:52.972543 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9d87d2e5-7dba-493b-851f-c95116e14605 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1294 microversion: 2.1 time: 0.240405 Aug 31 04:06:52.974555 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 39/70] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:52 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1294 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:53.070304 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:53.072213 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:53.090197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:53.121152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:53.121909 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:53.122484 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:53.127903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:53.128610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:53.136481 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:53.372702 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:53.373958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:53.401656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:53.402615 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:53.404829 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:53.410605 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:53.411421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:53.413753 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:53.734157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:53.747935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-abc94442-d231-45c8-a33d-8ccf6308fefc tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1273 microversion: 2.1 time: 0.684122 Aug 31 04:06:53.776386 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 32/71] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:53 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1273 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:53.805867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:53.806553 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:53.844062 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:53.851927 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:53.852682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:53.856982 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:53.857769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:53.858349 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:54.171068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:54.183204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:54.185208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:54.186570 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c8a41030-38c0-428c-a695-62eaf8f21469 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1339 microversion: 2.20 time: 0.818992 Aug 31 04:06:54.187833 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 40/72] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:53 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1339 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:54.192750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:54.193621 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:54.197017 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:54.203280 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:54.204193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:54.204889 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:54.205810 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:54.206465 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:54.207122 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:54.368129 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:54.372027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:54.385258 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-49edd278-5423-43ff-870e-42f00144d3d2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1294 microversion: 2.1 time: 0.196003 Aug 31 04:06:54.386565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 41/73] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:54 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1294 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:54.547640 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:54.559681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6c0be1b5-d4b8-4dcb-b1e4-92bd7a05d983 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.769495 Aug 31 04:06:54.560660 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 33/74] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:53 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:54.594036 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:54.595314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=18 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:54.675767 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-23909231-65b7-4eac-968b-3cccb1561524 req-d4aa2e69-8814-4004-af01-4ab06fc31090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05badbbb-888b-4ba8-8e63-c45489dabb5e", "tag": "992c7f80-18c6-4637-bdf4-bbd2517f5794"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:54.689437 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-23909231-65b7-4eac-968b-3cccb1561524 req-d4aa2e69-8814-4004-af01-4ab06fc31090 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:54.690168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-23909231-65b7-4eac-968b-3cccb1561524 req-d4aa2e69-8814-4004-af01-4ab06fc31090 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:54.691630 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-23909231-65b7-4eac-968b-3cccb1561524 req-d4aa2e69-8814-4004-af01-4ab06fc31090 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:54.716567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-23909231-65b7-4eac-968b-3cccb1561524 req-d4aa2e69-8814-4004-af01-4ab06fc31090 service nova] Creating event network-changed:992c7f80-18c6-4637-bdf4-bbd2517f5794 for instance 05badbbb-888b-4ba8-8e63-c45489dabb5e on hv-cinder-85391 Aug 31 04:06:54.717521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-23909231-65b7-4eac-968b-3cccb1561524 req-d4aa2e69-8814-4004-af01-4ab06fc31090 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 04:06:54.718264 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-23909231-65b7-4eac-968b-3cccb1561524 req-d4aa2e69-8814-4004-af01-4ab06fc31090 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 04:06:54.719488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:54.720172 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:54.720740 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:54.721741 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:54.722197 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:54.722610 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:54.732484 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.compute.rpcapi [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 04:06:54.733364 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] Releasing lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 04:06:54.752386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4dfb93c4-ec3e-44dc-8b06-6aef7951b586 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163157 Aug 31 04:06:54.753350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 42/75] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:54.773302 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:54.773910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:54.781154 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:54.781649 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:54.782493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:54.783692 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:54.784302 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:54.784887 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:54.864620 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:54.894607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6e61b136-a56c-4c8b-95e2-dd3d8fcbb17d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1273 microversion: 2.1 time: 0.124722 Aug 31 04:06:54.914904 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 34/76] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:54 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:55.215296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:55.216591 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:55.224375 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:55.225145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:55.226167 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:55.227170 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:55.228201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:55.228995 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:55.380113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:55.388988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:55.391238 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:55.392559 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-21b9858c-b9b7-4656-8e76-e5de4c3852c2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.185258 Aug 31 04:06:55.393145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 43/77] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:55 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:55.414171 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:55.414810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:55.420931 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:55.421494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:55.421873 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:55.422570 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:55.423045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:55.423464 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:55.485451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:55.493614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3dffc86d-e7a5-42c2-b4b4-2c87750d0369 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1294 microversion: 2.1 time: 0.083883 Aug 31 04:06:55.494398 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 35/78] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:55 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:06:55.581232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:55.581857 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:55.588925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:55.589420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:55.589936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:55.590683 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:55.591176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:55.591597 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:55.759216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:55.769475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4b581666-1b25-462f-80da-fdf0d43c0696 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.192525 Aug 31 04:06:55.784060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 44/79] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:55 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:55.921886 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:55.922674 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:55.928926 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:55.929478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:55.930023 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:55.931072 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:55.931599 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:55.932019 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:55.997762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:56.001663 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:56.006141 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-72823222-6245-4b62-bfaa-3f9b08d43665 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1273 microversion: 2.1 time: 0.088255 Aug 31 04:06:56.006728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 36/80] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:55 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:56.415600 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:56.416204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:56.422896 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:56.423554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:56.423979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:56.424660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:56.425105 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:56.425530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:56.514163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:56.514764 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:56.522003 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:56.522408 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:56.522834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:56.523530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:56.524002 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:56.524421 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:56.572436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:56.581037 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:56.582470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:56.583606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-305fc0c5-ac53-4cda-8d40-eb8d7dab95e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.171996 Aug 31 04:06:56.584151 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 45/81] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:56 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:56.591419 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:56.594666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=30 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:56.601459 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e268973c-c67d-41d9-a832-20d1648e6b53 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1294 microversion: 2.1 time: 0.091515 Aug 31 04:06:56.602028 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 37/82] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:56 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:56.791186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:56.792269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:56.800348 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:56.800695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:56.801355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:56.802059 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:56.802646 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:56.803177 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:56.954386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:56.962720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b125bea6-2cab-4dd9-b2d6-a5d0447e6713 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.176008 Aug 31 04:06:56.963333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 46/83] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:56 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:57.028067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:57.028643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:57.035016 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:57.035535 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:57.035963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:57.036634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:57.037082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:57.037474 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:57.103357 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:57.112094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-648b9d08-f631-406c-859b-b0a4d2206eb4 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1273 microversion: 2.1 time: 0.088087 Aug 31 04:06:57.112643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 38/84] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:57 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:57.608250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:57.609355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:57.621809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:57.622454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:57.622947 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:57.624482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:57.624788 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:57.625255 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:57.625692 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:57.625835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:57.633659 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:57.634064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:57.634498 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:57.635437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:57.636984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:57.637625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:57.971741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:57.985493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d7e0d603-cf00-49cb-9fed-d8e2860788cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1312 microversion: 2.1 time: 0.359673 Aug 31 04:06:57.986259 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 39/85] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:57 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:06:58.014106 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:58.015200 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:58.035370 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:58.036092 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:58.036404 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:58.037144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:58.037598 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:58.038024 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:58.378098 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:58.394042 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:58.422658 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:58.425297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e1baf23d-0d23-4aad-b355-21434da0a513 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.821078 Aug 31 04:06:58.426457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 47/86] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:57 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:58.444899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:58.445538 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:58.456386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:58.457180 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:58.457878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:58.459564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:58.464753 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:58.465389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:58.678532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=8 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:58.790721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:58.805579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8087b6ac-14ed-4679-ab08-b0e9b8596492 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1279 microversion: 2.1 time: 0.377233 Aug 31 04:06:58.807289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 48/87] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:58 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1279 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:58.846811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:58.866666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7993a4ed-d2aa-421b-b6ee-e9e49e9ca133 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.864300 Aug 31 04:06:58.867541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 40/88] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:57 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:59.014468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:59.015141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:59.021554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.022031 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.022613 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.023496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.023938 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.024645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.147062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:59.157149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-25e9e981-b0f7-4ad9-9837-e9eca9411945 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1300 microversion: 2.1 time: 0.147301 Aug 31 04:06:59.158033 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 49/89] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:59 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1300 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:06:59.411650 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-eaeee666-50d1-4458-b94a-25954b975334 req-46c9dc0a-19fd-4bc5-9eb3-deeae863a494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675abe1e-ac1e-458b-b5ac-745a7f6917b7", "tag": "4a38be32-98cb-48fd-b704-e08ed42a7fef"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:06:59.423263 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-eaeee666-50d1-4458-b94a-25954b975334 req-46c9dc0a-19fd-4bc5-9eb3-deeae863a494 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.424099 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-eaeee666-50d1-4458-b94a-25954b975334 req-46c9dc0a-19fd-4bc5-9eb3-deeae863a494 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.424879 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-eaeee666-50d1-4458-b94a-25954b975334 req-46c9dc0a-19fd-4bc5-9eb3-deeae863a494 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.439629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-eaeee666-50d1-4458-b94a-25954b975334 req-46c9dc0a-19fd-4bc5-9eb3-deeae863a494 service nova] Creating event network-changed:4a38be32-98cb-48fd-b704-e08ed42a7fef for instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 on hv-cinder-85391 Aug 31 04:06:59.445381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-eaeee666-50d1-4458-b94a-25954b975334 req-46c9dc0a-19fd-4bc5-9eb3-deeae863a494 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040259 Aug 31 04:06:59.446494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 41/90] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:06:59.453311 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:59.454326 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:59.461791 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.462454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.463135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.464055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.464672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.465095 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.830141 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:59.831742 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:59.841417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.841910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.842392 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.843318 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.844199 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.844779 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.890966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:59.899805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:59.901205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:59.902312 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b267633f-b83c-439e-bdee-18521d9a807d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.454331 Aug 31 04:06:59.903215 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 50/91] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:06:59 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:06:59.907710 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:06:59.908491 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:06:59.915679 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.916165 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.916672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.917605 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:06:59.918056 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:06:59.918483 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:06:59.954230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:06:59.964377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c9df3d9c-1dac-42a4-a0f0-22181aa25e99 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1279 microversion: 2.1 time: 0.140460 Aug 31 04:06:59.965197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 42/92] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:59 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:00.181093 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:00.182068 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:00.192971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:00.194770 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:00.195427 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:00.197219 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:00.200687 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:00.201477 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:00.290813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:00.311289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ee0ccca7-80c4-4bc3-adca-e08b9f5e5b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.406723 Aug 31 04:07:00.312771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 51/93] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:06:59 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:00.409792 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:00.421264 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8ea62fc7-4012-49b9-9952-309a4cd071b1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.245359 Aug 31 04:07:00.423128 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 43/94] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:00 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:00.930590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:00.932750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:00.938627 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:00.939859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:00.940458 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:00.941692 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:00.942563 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:00.943178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:00.984889 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:00.985486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:00.992836 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:00.993447 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:00.994006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:00.995063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:00.995645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:00.996238 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:01.160498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:01.171271 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:01.172733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:01.174131 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-214f6d37-d320-4133-9c90-1bf223959ba0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.247823 Aug 31 04:07:01.174689 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 52/95] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:00 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:01.198661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:01.210676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9729a480-1cb4-45b7-9113-dae7e850673f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.229466 Aug 31 04:07:01.211762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 44/96] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:00 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:01.341981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:01.342657 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:01.350513 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:01.351247 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:01.351760 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:01.352675 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:01.353303 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:01.353723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:01.464536 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:01.470202 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:01.481123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:01.481916 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:01.482850 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:01.484945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:01.485511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:01.486303 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:01.590850 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:01.601444 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-95bf12d0-686b-4bd9-9548-8fa19289ea6b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.264576 Aug 31 04:07:01.602293 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 53/97] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:01 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:01.718156 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:01.726573 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c4ca1e7c-c631-4d0e-8252-7a154f7b2917 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.269313 Aug 31 04:07:01.727482 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 45/98] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:01 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:02.200163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:02.200940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:02.207702 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:02.208231 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:02.208670 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:02.209358 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:02.209806 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:02.210222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:02.233746 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:02.234273 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:02.240984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:02.241478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:02.241918 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:02.242616 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:02.243256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:02.243684 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:02.426685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:02.443680 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:02.445546 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:02.446940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-665c6476-2c9d-43af-b82b-2b9abadf4882 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.251822 Aug 31 04:07:02.461352 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 54/99] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:02 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:02.631012 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:02.631939 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:02.657931 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:02.668266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:02.668939 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:02.669924 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:02.670517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:02.671164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:02.702190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:02.715312 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-17ed5c9b-d09a-4409-848e-e05b5302a39e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.484305 Aug 31 04:07:02.721318 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 46/100] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:02 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:02.761899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:02.762780 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:02.770879 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:02.771402 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:02.771835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:02.772539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:02.772979 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:02.773579 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:03.176310 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:03.185389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f7f2576a-722e-4255-838c-ef8941ccdebb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.558576 Aug 31 04:07:03.187400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 55/101] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:02 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:03.290444 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:03.300236 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ac755469-8216-4a44-8d06-78caedd3f882 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.542084 Aug 31 04:07:03.301360 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 47/102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:02 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:03.471222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:03.472461 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:03.477795 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:03.478279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:03.479608 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:03.480218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:03.480700 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:03.481111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:03.740530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:03.741625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:03.751070 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:03.751572 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:03.752037 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:03.752733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:03.753208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:03.753623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:04.033725 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:04.046527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:04.051293 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:04.053660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-eef7b100-d692-4829-b7b1-e1cdbce5e5cf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.586638 Aug 31 04:07:04.059418 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 56/103] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:03 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:04.213269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:04.214222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:04.229590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:04.230954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:04.231703 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:04.232500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:04.232981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:04.233462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:04.262644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:04.278887 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e9fe3438-f801-434e-9fe5-510fba0f39eb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.542444 Aug 31 04:07:04.289485 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 48/104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:03 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:04.322414 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:04.323161 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:04.335399 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:04.335974 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:04.338614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:04.339773 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:04.340965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:04.341691 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:04.732482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:05.100005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:05.111608 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-30a08fce-d2fb-457b-baa6-5963b9d88600 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.903907 Aug 31 04:07:05.113493 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 57/105] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:04 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:05.133366 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:05.136836 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:05.147649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:05.148148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:05.148627 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:05.149333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:05.150081 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:05.150517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:05.278366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:05.288643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-86513aff-bd22-4fda-a9bc-7204ca84a951 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.970674 Aug 31 04:07:05.289379 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 49/106] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:04 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:05.354452 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-7034f005-3c38-4a69-a67d-4db8854fd3c6 req-fd50cffa-3495-4bf0-b7fe-80c10d53618b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5844439f-0f36-44bf-8d44-f7c95e7954c4", "name": "network-vif-plugged", "status": "completed", "tag": "c70b840e-d3e2-4644-b547-1b19ffa1be8d"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:05.365010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-7034f005-3c38-4a69-a67d-4db8854fd3c6 req-fd50cffa-3495-4bf0-b7fe-80c10d53618b service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:05.365492 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-7034f005-3c38-4a69-a67d-4db8854fd3c6 req-fd50cffa-3495-4bf0-b7fe-80c10d53618b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:05.365921 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-7034f005-3c38-4a69-a67d-4db8854fd3c6 req-fd50cffa-3495-4bf0-b7fe-80c10d53618b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:05.377878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-7034f005-3c38-4a69-a67d-4db8854fd3c6 req-fd50cffa-3495-4bf0-b7fe-80c10d53618b service nova] Creating event network-vif-plugged:c70b840e-d3e2-4644-b547-1b19ffa1be8d for instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 on hv-cinder-85391 Aug 31 04:07:05.383470 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-7034f005-3c38-4a69-a67d-4db8854fd3c6 req-fd50cffa-3495-4bf0-b7fe-80c10d53618b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092696 Aug 31 04:07:05.384252 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 50/107] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:05.389530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:05.390254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:05.396489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:05.396973 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:05.397613 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:05.398313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:05.398766 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:05.399247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:05.503403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:05.507118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:05.513121 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:05.514738 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:05.515976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-80f1faf0-130e-40fd-b296-54a2489c1f57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.400524 Aug 31 04:07:05.516510 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 58/108] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:05 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:05.535413 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-83946035-6ec7-461f-9b38-44e819093fee req-e09b7247-f381-46e9-84e2-8ea221785396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9983bf-7a14-46ef-89bf-05fa2102ea35", "tag": "6b575fcc-5e74-46cb-a2b3-d057f4200d55"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:05.544939 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-83946035-6ec7-461f-9b38-44e819093fee req-e09b7247-f381-46e9-84e2-8ea221785396 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:05.545400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-83946035-6ec7-461f-9b38-44e819093fee req-e09b7247-f381-46e9-84e2-8ea221785396 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:05.545863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-83946035-6ec7-461f-9b38-44e819093fee req-e09b7247-f381-46e9-84e2-8ea221785396 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:05.557991 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-83946035-6ec7-461f-9b38-44e819093fee req-e09b7247-f381-46e9-84e2-8ea221785396 service nova] Creating event network-changed:6b575fcc-5e74-46cb-a2b3-d057f4200d55 for instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 on hv-cinder-85391 Aug 31 04:07:05.562738 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-83946035-6ec7-461f-9b38-44e819093fee req-e09b7247-f381-46e9-84e2-8ea221785396 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045024 Aug 31 04:07:05.563558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 59/109] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:05.636558 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:05.644678 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-566d31ca-539f-439f-a9ea-6b2c98231264 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.259105 Aug 31 04:07:05.645801 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 51/110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:05 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:06.136704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:06.137972 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:06.144465 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:06.144938 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:06.145359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:06.146035 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:06.146592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:06.146875 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:06.298206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:06.306228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6ebd26ab-f894-4966-bd2f-20b409a5e034 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.173565 Aug 31 04:07:06.306729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 60/111] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:06 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:06.309872 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:06.310479 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:06.316910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:06.317451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:06.317918 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:06.318600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:06.319347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:06.319820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:06.461355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:06.469424 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3b74e6dd-0038-4c87-8c00-c21888a7418a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.163727 Aug 31 04:07:06.469996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 52/112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:06 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:06.538169 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:06.538852 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:06.545171 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:06.545711 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:06.546571 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:06.547434 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:06.547932 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:06.548420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:06.667317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:06.667965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:06.677273 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:06.677980 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:06.678625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:06.679442 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:06.679890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:06.680998 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:06.688830 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:06.698602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:06.700254 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:06.701492 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bdbb9064-0090-40f8-9dfb-0ec4d0c12a06 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.167418 Aug 31 04:07:06.702296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 61/113] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:06 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:06.826087 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:06.835115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-111c4520-5746-41ab-8607-b1198fc83c14 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.173146 Aug 31 04:07:06.835700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 53/114] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:06 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:07.325949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:07.326497 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:07.333397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.334084 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.334714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.335433 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.335884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.336307 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.478225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:07.488395 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8dda3de2-854f-4fbc-812b-7810a74e1cc0 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.166310 Aug 31 04:07:07.488994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 62/115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:07 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:07.490212 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:07.490892 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:07.496923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.497409 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.497847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.498561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.499150 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.499576 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.585289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a5a6f97a-f2d0-443f-b0fa-c53eec32f5a8 req-dbfa790b-2359-4cd3-b9d1-32d99cd07422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5504b0-52b4-4d1a-a67b-6d6e26053371", "tag": "55988fa5-eb1f-435f-ba39-34e32cd7d071"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:07.594600 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a5a6f97a-f2d0-443f-b0fa-c53eec32f5a8 req-dbfa790b-2359-4cd3-b9d1-32d99cd07422 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.595066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a5a6f97a-f2d0-443f-b0fa-c53eec32f5a8 req-dbfa790b-2359-4cd3-b9d1-32d99cd07422 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.595498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a5a6f97a-f2d0-443f-b0fa-c53eec32f5a8 req-dbfa790b-2359-4cd3-b9d1-32d99cd07422 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.606841 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a5a6f97a-f2d0-443f-b0fa-c53eec32f5a8 req-dbfa790b-2359-4cd3-b9d1-32d99cd07422 service nova] Creating event network-changed:55988fa5-eb1f-435f-ba39-34e32cd7d071 for instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 on hv-cinder-85391 Aug 31 04:07:07.612274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a5a6f97a-f2d0-443f-b0fa-c53eec32f5a8 req-dbfa790b-2359-4cd3-b9d1-32d99cd07422 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030798 Aug 31 04:07:07.612915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 63/116] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:07.650697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:07.654255 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:07.658947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a4dc9a70-d8c6-439d-bf07-40249548d319 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.172906 Aug 31 04:07:07.659786 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 54/117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:07 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:07.725109 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:07.725877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:07.732710 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.733306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.734282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.734969 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.735451 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.735873 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.856898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:07.857410 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:07.863542 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.864026 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.864763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.865449 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:07.865898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:07.866314 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:07.876954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:07.885346 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:07.886783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:07.887916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e7462802-b69d-421a-8110-868b93a54648 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.167313 Aug 31 04:07:07.888476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 64/118] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:07 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:07.997023 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:08.007145 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-516158c0-b678-4a6e-8bf8-cea9e87da305 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.154766 Aug 31 04:07:08.008211 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 55/119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:07 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:08.509607 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:08.510127 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:08.523386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:08.523700 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:08.524237 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:08.524945 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:08.525397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:08.525816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:08.681688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:08.683979 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:08.694285 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:08.695076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:08.695707 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:08.697042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:08.698030 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:08.699176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:08.745837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:08.754475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bc2277cd-204c-4ce7-b62c-01c44b855fcd tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.248939 Aug 31 04:07:08.755493 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 65/120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:08 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:08.852744 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:08.860914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-416ca7c1-f988-484d-b18d-9a5bfff9bb79 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.184672 Aug 31 04:07:08.861506 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 56/121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:08 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:08.911599 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:08.912217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:08.918835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:08.919395 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:08.919837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:08.920543 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:08.921231 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:08.921688 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:09.028160 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:09.028768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:09.036431 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:09.037127 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:09.037772 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:09.038859 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:09.039501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:09.040100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:09.084779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:09.102574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:09.103965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:09.105091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2f323ab4-c449-4339-940e-049e29f53035 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.197574 Aug 31 04:07:09.107638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 66/122] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:08 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:09.189935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:09.197964 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-83e44ba3-759e-4754-9ad3-ebc3b93f7822 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.173579 Aug 31 04:07:09.198554 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 57/123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:09 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:09.776205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:09.776912 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:09.783799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:09.784276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:09.784704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:09.785381 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:09.785796 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:09.786245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:09.881831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:09.882411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:09.888734 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:09.889217 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:09.889954 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:09.890678 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:09.891163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:09.891589 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:09.920627 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:09.928915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fcea225f-0708-4cf1-8857-2ea4c7eac175 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.157083 Aug 31 04:07:09.929496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 67/124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:09 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:10.021575 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:10.033970 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1e3e9709-ce47-486a-9e92-cf30a774fcc8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.155591 Aug 31 04:07:10.034619 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 58/125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:09 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:10.135878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:10.135878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:10.137248 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:10.137813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:10.138303 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:10.139222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:10.139945 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:10.140365 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:10.219798 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:10.220612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:10.227402 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:10.227876 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:10.228310 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:10.229004 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:10.229667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:10.230087 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:10.464932 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:10.473504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:10.474990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:10.476382 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a59d5404-5c7a-476f-8e0a-b91ee1659480 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.350047 Aug 31 04:07:10.477052 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 68/126] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:10 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:10.488716 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:10.501932 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ecba016c-97e3-45db-b960-3b450e5cb742 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.286420 Aug 31 04:07:10.502524 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 59/127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:10 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:10.955297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:10.955888 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:10.962500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:10.963045 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:10.963524 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:10.964245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:10.964694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:10.965137 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:11.059192 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:11.059792 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:11.066267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:11.066748 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:11.067247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:11.067939 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:11.068378 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:11.068788 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:11.097244 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:11.105286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f2fae8fa-cc74-4f1f-b9ed-b5bd159501eb tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.157874 Aug 31 04:07:11.105877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 69/128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:10 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:11.479339 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:11.479757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d677d10c-2c7b-4477-8d2e-46f1374025e0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.424177 Aug 31 04:07:11.480190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 60/129] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:11 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:11.502645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:11.503452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:11.513559 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:11.514049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:11.514994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:11.516583 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:11.517718 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:11.518250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:11.529702 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:11.531351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:11.543844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:11.544984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:11.545657 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:11.546731 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:11.547341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:11.559345 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:11.856537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:11.868916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:11.870975 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:11.872701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f657dcbf-7be4-4119-b22b-ebd0494922f0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.376431 Aug 31 04:07:11.874270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 70/130] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:11 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:11.908453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-6a02a4ec-64ff-4951-9d47-f59a4398131d req-ec6a46c0-2d32-4b17-862a-741dde01f07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05badbbb-888b-4ba8-8e63-c45489dabb5e", "name": "network-vif-plugged", "status": "completed", "tag": "992c7f80-18c6-4637-bdf4-bbd2517f5794"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:11.920317 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6a02a4ec-64ff-4951-9d47-f59a4398131d req-ec6a46c0-2d32-4b17-862a-741dde01f07f service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:11.920898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6a02a4ec-64ff-4951-9d47-f59a4398131d req-ec6a46c0-2d32-4b17-862a-741dde01f07f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:11.921239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6a02a4ec-64ff-4951-9d47-f59a4398131d req-ec6a46c0-2d32-4b17-862a-741dde01f07f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:11.933281 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-6a02a4ec-64ff-4951-9d47-f59a4398131d req-ec6a46c0-2d32-4b17-862a-741dde01f07f service nova] Creating event network-vif-plugged:992c7f80-18c6-4637-bdf4-bbd2517f5794 for instance 05badbbb-888b-4ba8-8e63-c45489dabb5e on hv-cinder-85391 Aug 31 04:07:11.938463 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-6a02a4ec-64ff-4951-9d47-f59a4398131d req-ec6a46c0-2d32-4b17-862a-741dde01f07f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034544 Aug 31 04:07:11.939139 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 71/131] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:07:11.951617 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:11.961140 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b33b699b-7d7d-40fa-b41f-09b7fa8c1978 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.439034 Aug 31 04:07:11.961919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 61/132] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:11 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:12.127510 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:12.128206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:12.134434 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:12.134926 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:12.135389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:12.136075 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:12.136529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:12.136950 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:12.501367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:12.501956 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:12.509645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:12.510134 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:12.510567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:12.511300 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:12.511756 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:12.512174 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:12.584811 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:12.593645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e84fa52b-586e-4b46-8105-e38eb65d6005 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1315 microversion: 2.1 time: 0.470392 Aug 31 04:07:12.594355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 72/133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:12 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:12.718490 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:12.727062 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-371c1981-3eca-494c-a019-766b99aa3490 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.229656 Aug 31 04:07:12.727650 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 62/134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:12 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:12.894968 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:12.895623 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:12.901642 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:12.902118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:12.902540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:12.903254 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:12.903856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:12.904269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:12.984199 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:12.985055 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:12.991655 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:12.992142 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:12.992746 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:12.993451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:12.993903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:12.994320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:13.133044 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:13.143688 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:13.145117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:13.146221 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bbaced2e-312d-4f52-a45f-8125b8069ff0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.255078 Aug 31 04:07:13.146798 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 73/135] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:12 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:13.215387 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:13.223520 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f593aab7-2f66-45c3-a895-acb0e075680e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.243973 Aug 31 04:07:13.224086 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 63/136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:12 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:13.620352 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:13.620954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:13.626931 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:13.627657 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:13.628322 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:13.629074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:13.629529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:13.629952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:13.748708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:13.751321 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:13.757582 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:13.758060 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:13.758491 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:13.759247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:13.759696 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:13.760116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:13.794934 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:13.804294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ab66e839-3356-444a-af4d-86af388d1a5e tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1503 microversion: 2.1 time: 0.187764 Aug 31 04:07:13.804906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 74/137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:13 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:13.950225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:13.959109 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-23b4dc3e-67e5-4498-bf07-04f38baece05 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.214346 Aug 31 04:07:13.960007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 64/138] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:13 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:13.978112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-d212b026-3cd2-4904-ae65-1a8c139757fa req-a46e552b-945a-4fd5-8469-006b3f74bb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675abe1e-ac1e-458b-b5ac-745a7f6917b7", "name": "network-vif-plugged", "status": "completed", "tag": "4a38be32-98cb-48fd-b704-e08ed42a7fef"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:13.989577 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d212b026-3cd2-4904-ae65-1a8c139757fa req-a46e552b-945a-4fd5-8469-006b3f74bb61 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:13.990312 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d212b026-3cd2-4904-ae65-1a8c139757fa req-a46e552b-945a-4fd5-8469-006b3f74bb61 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:13.990785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d212b026-3cd2-4904-ae65-1a8c139757fa req-a46e552b-945a-4fd5-8469-006b3f74bb61 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:14.008420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-d212b026-3cd2-4904-ae65-1a8c139757fa req-a46e552b-945a-4fd5-8469-006b3f74bb61 service nova] Creating event network-vif-plugged:4a38be32-98cb-48fd-b704-e08ed42a7fef for instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 on hv-cinder-85391 Aug 31 04:07:14.016478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-d212b026-3cd2-4904-ae65-1a8c139757fa req-a46e552b-945a-4fd5-8469-006b3f74bb61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041424 Aug 31 04:07:14.021519 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 75/139] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:07:14.168822 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:14.169540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:14.178253 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:14.178978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:14.179564 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:14.180425 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:14.180867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:14.181287 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:14.245347 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:14.246153 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:14.253448 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:14.253809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:14.254453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:14.255545 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:14.256233 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:14.256852 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:14.453983 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:14.463353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:14.465279 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:14.466505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b3b5217c-1c44-42d9-9421-9ba7acc2aa98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.301591 Aug 31 04:07:14.467169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 65/140] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:14 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:14.502137 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:14.511469 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-947a369a-3d01-4130-bda9-d45308632f22 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.270644 Aug 31 04:07:14.512175 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 76/141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:14 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:14.981500 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:14.982120 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:15.001907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:15.002415 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:15.003017 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:15.003905 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:15.005109 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:15.005684 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:15.168551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:15.181075 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7be32c62-7b64-4134-b713-d507cb718bb8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.203872 Aug 31 04:07:15.182059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 66/142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:14 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:15.288148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0903c26-43c6-4f56-bd0e-05ca2652fb9c"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:15.291324 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:15.302752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:15.303723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:15.304489 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:15.305672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:15.306487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:15.307054 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:15.491508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:15.492020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:15.501045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:15.501787 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:15.502421 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:15.504142 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:15.504888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:15.512448 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:15.771584 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:15.779899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:15.781343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:15.782470 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1f71bd9d-94db-45d3-974e-bc895cf57db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.296235 Aug 31 04:07:15.783052 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 67/143] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:15 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:15.788902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:15.789704 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:15.795967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:15.796689 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:15.797276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:15.798115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:15.799123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:15.799691 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:15.979206 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:15.988604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-17b70b4f-9612-4547-a386-595a805751b9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.203471 Aug 31 04:07:15.990228 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 68/144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:15 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:16.200996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:16.205976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:16.206920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:16.217044 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:16.217773 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:16.220390 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:16.221248 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:16.221933 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:16.222709 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:16.442365 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:16.456429 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-33a43ca5-69e0-4854-a1ae-8ec368ca02cc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.253881 Aug 31 04:07:16.457404 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 69/145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:16 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:16.811336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:16.813102 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:16.822391 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:16.823428 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:16.824525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:16.828370 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:16.830346 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:16.831480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:16.927575 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c3fd9134-f8d2-4f0a-85ca-ff0640bf9c20 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "POST /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.645822 Aug 31 04:07:16.933594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 77/146] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:07:15 2022] POST /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4/os-volume_attachments => generated 194 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:17.015057 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:17.015998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:17.023564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:17.024060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:17.024184 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:17.024629 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:17.025330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:17.026073 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:17.026496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:17.033325 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:17.034827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:17.035973 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6243d350-6e32-4f60-9384-7a4f5b4d13bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.231331 Aug 31 04:07:17.050755 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 70/147] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:16 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:17.183290 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:17.191376 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-47fecd6e-e4f2-4010-a6de-be5b85654b62 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.182117 Aug 31 04:07:17.191952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 78/148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:17 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:17.485295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:17.486219 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:17.493215 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:17.493680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:17.494416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:17.494915 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:17.495435 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:17.495867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:17.522324 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:17.675925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:17.685978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-59bf3990-d2c2-431d-8eaa-52730d3a1cb4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.209066 Aug 31 04:07:17.686557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 71/149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:17 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:18.058654 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:18.059462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:18.070249 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:18.071045 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:18.071505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:18.072488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:18.073458 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:18.074042 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:18.211557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:18.212168 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:18.220523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:18.221020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:18.221471 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:18.222146 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:18.222610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:18.224923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:18.284980 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:18.302508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:18.304761 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:18.306136 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3593b22b-1ae1-4de4-b842-4ae4b08a7f72 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.251795 Aug 31 04:07:18.319506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 79/150] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:18 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:18.380100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:18.388271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-90539188-e598-400a-8828-1aa7d905bb93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.180426 Aug 31 04:07:18.388838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 72/151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:18 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:18.711040 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:18.711703 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:18.719921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:18.720467 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:18.720897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:18.721568 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:18.722044 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:18.722469 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:18.853917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:18.861929 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b11873c7-5343-432c-b487-6e53b71b04f6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.155891 Aug 31 04:07:18.862771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 80/152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:18 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:19.329503 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:19.330042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:19.336035 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:19.336515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:19.336930 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:19.337806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:19.338253 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:19.338667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:19.408193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:19.408800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:19.417193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:19.417698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:19.418130 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:19.418884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:19.419803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:19.419803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:19.765294 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:19.776104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:19.777749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:19.779042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-155160b3-1821-42da-9f0f-b363862ab736 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1406 microversion: 2.20 time: 0.453842 Aug 31 04:07:19.780079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 73/153] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:19 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:19.791780 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:19.801869 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6c949937-a7fa-4f04-8db4-8f0fdfd46af9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.397499 Aug 31 04:07:19.803334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 81/154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:19 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:19.881975 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:19.882915 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:19.889378 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:19.889974 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:19.890580 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:19.891364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:19.891932 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:19.892354 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:20.059967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:20.069332 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a277d4ff-1194-4e86-ad9d-0a5e4a7c3a55 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.191427 Aug 31 04:07:20.069954 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 74/155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:19 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:20.805559 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:20.806169 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:20.813058 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:20.813542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:20.813971 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:20.814664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:20.815154 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:20.815575 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:20.823060 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:20.823986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:20.830189 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:20.830790 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:20.831474 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:20.832265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:20.832811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:20.833342 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:21.019600 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:21.033734 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:21.033970 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:21.035917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:21.037259 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f7301048-ade5-4ca7-b687-f71237711054 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1598 microversion: 2.20 time: 0.235977 Aug 31 04:07:21.038113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 82/156] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:07:20 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1598 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:07:21.041812 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7ea98855-65bd-43d2-a8ce-eb029fe3deb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.222567 Aug 31 04:07:21.064644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:21.065137 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:21.067085 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 75/157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:20 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:21.071488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:21.071973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:21.072401 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:21.073098 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:21.073568 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:21.074013 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:21.090817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:21.091491 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:21.101796 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:21.105009 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:21.105792 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:21.106514 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:21.106962 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:21.108064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:21.163624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-416d0eac-69ee-4bb0-9beb-91039d929c29 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103220 Aug 31 04:07:21.164411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 83/158] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Aug 31 04:07:21 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:07:21.299699 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:21.308555 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-033053d7-b45f-4102-afc2-9851986e108b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.222479 Aug 31 04:07:21.309469 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 76/159] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:21 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:22.067695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:22.068369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:22.075456 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:22.075648 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:22.076213 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:22.076910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:22.077345 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:22.077784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:22.218142 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:22.225756 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d380a918-7fa7-49a6-bc84-7e272696ed93 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.162572 Aug 31 04:07:22.226432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 84/160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:22 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:22.330323 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:22.331020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:22.337668 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:22.338221 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:22.338745 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:22.339492 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:22.340001 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:22.340499 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:22.472088 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:22.480946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-743a36ac-98d8-4680-82cc-1d27092147c2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.154600 Aug 31 04:07:22.481722 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 77/161] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:22 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:22.613802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-5609e11c-18dc-4575-bcad-3b470b17a3aa req-050c5342-5aca-4a9b-a03c-0410e986bc32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675abe1e-ac1e-458b-b5ac-745a7f6917b7", "tag": "4a38be32-98cb-48fd-b704-e08ed42a7fef"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:22.624521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5609e11c-18dc-4575-bcad-3b470b17a3aa req-050c5342-5aca-4a9b-a03c-0410e986bc32 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:22.625002 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5609e11c-18dc-4575-bcad-3b470b17a3aa req-050c5342-5aca-4a9b-a03c-0410e986bc32 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:22.625429 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5609e11c-18dc-4575-bcad-3b470b17a3aa req-050c5342-5aca-4a9b-a03c-0410e986bc32 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:22.636761 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-5609e11c-18dc-4575-bcad-3b470b17a3aa req-050c5342-5aca-4a9b-a03c-0410e986bc32 service nova] Creating event network-changed:4a38be32-98cb-48fd-b704-e08ed42a7fef for instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 on hv-cinder-85391 Aug 31 04:07:22.642517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-5609e11c-18dc-4575-bcad-3b470b17a3aa req-050c5342-5aca-4a9b-a03c-0410e986bc32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032414 Aug 31 04:07:22.643139 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 85/162] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:23.247411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:23.248097 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:23.254071 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=91 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:23.256464 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:23.257186 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:23.257361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:23.258234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:23.258831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:23.259417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:23.428331 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-7cdc9108-e696-45ce-be12-0355fa9a897e req-0a7e6726-1439-4d0a-ba7e-82e96aedb845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9983bf-7a14-46ef-89bf-05fa2102ea35", "name": "network-vif-plugged", "status": "completed", "tag": "6b575fcc-5e74-46cb-a2b3-d057f4200d55"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:23.444450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7cdc9108-e696-45ce-be12-0355fa9a897e req-0a7e6726-1439-4d0a-ba7e-82e96aedb845 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:23.445010 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7cdc9108-e696-45ce-be12-0355fa9a897e req-0a7e6726-1439-4d0a-ba7e-82e96aedb845 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:23.445514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7cdc9108-e696-45ce-be12-0355fa9a897e req-0a7e6726-1439-4d0a-ba7e-82e96aedb845 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:23.479736 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-7cdc9108-e696-45ce-be12-0355fa9a897e req-0a7e6726-1439-4d0a-ba7e-82e96aedb845 service nova] Creating event network-vif-plugged:6b575fcc-5e74-46cb-a2b3-d057f4200d55 for instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 on hv-cinder-85391 Aug 31 04:07:23.496488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-7cdc9108-e696-45ce-be12-0355fa9a897e req-0a7e6726-1439-4d0a-ba7e-82e96aedb845 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070392 Aug 31 04:07:23.496862 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 86/163] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:07:23.496975 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:23.507504 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-dedaa317-edb7-45ae-a1fe-7c633dead267 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.265350 Aug 31 04:07:23.508305 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 78/164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:23 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:23.516312 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:23.528063 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:23.539460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:23.540002 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:23.540447 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:23.544107 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:23.544800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:23.545623 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:23.862953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:23.874684 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-17b7ee9b-61d2-4296-ac16-b52571ee5a34 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.376411 Aug 31 04:07:23.875465 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 87/165] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:23 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:24.529910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:24.531744 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:24.539163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:24.539701 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:24.540141 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:24.541003 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:24.541531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:24.541945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:24.697451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:24.705671 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4cfe3012-fe9d-4533-8c3c-751cef9b9931 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.180907 Aug 31 04:07:24.706457 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 79/166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:24 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:24.897377 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:24.898061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:24.900143 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=94 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:24.905961 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:24.906521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:24.907018 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:24.907804 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:24.908338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:24.908911 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:25.042292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:25.050795 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6e6a28e6-6158-440d-8a8f-e024e1f64be1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.159701 Aug 31 04:07:25.051400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 88/167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:24 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:25.515682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-c40467e6-84f1-4b7c-8442-c9ec90ff3b4b req-77a8f45a-40e9-4b35-90fd-0b6f61091190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5504b0-52b4-4d1a-a67b-6d6e26053371", "name": "network-vif-plugged", "status": "completed", "tag": "55988fa5-eb1f-435f-ba39-34e32cd7d071"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:25.525489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c40467e6-84f1-4b7c-8442-c9ec90ff3b4b req-77a8f45a-40e9-4b35-90fd-0b6f61091190 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:25.525985 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c40467e6-84f1-4b7c-8442-c9ec90ff3b4b req-77a8f45a-40e9-4b35-90fd-0b6f61091190 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:25.526404 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c40467e6-84f1-4b7c-8442-c9ec90ff3b4b req-77a8f45a-40e9-4b35-90fd-0b6f61091190 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:25.537920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-c40467e6-84f1-4b7c-8442-c9ec90ff3b4b req-77a8f45a-40e9-4b35-90fd-0b6f61091190 service nova] Creating event network-vif-plugged:55988fa5-eb1f-435f-ba39-34e32cd7d071 for instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 on hv-cinder-85391 Aug 31 04:07:25.543093 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-c40467e6-84f1-4b7c-8442-c9ec90ff3b4b req-77a8f45a-40e9-4b35-90fd-0b6f61091190 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Aug 31 04:07:25.543659 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 80/168] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:25.726358 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:25.727014 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:25.733742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:25.734229 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:25.734655 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:25.735368 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:25.735820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:25.736239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:25.881386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:25.889563 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b25a1893-e7f7-4e31-ab3a-6bb442897d4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.166986 Aug 31 04:07:25.890171 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 89/169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:25 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:26.075827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:26.077063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:26.087574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:26.088361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:26.089071 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:26.090182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:26.090922 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:26.091660 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:26.224652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:26.237455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8136a622-4fb1-451d-88d4-e477e4910812 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.168744 Aug 31 04:07:26.237998 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 81/170] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:26 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:26.910145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:26.910834 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:26.918066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:26.918625 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:26.919189 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:26.919959 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:26.920476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:26.920966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:27.054282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:27.062112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c16661f4-69f0-4ade-b01b-b52571851d82 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.155917 Aug 31 04:07:27.062673 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 90/171] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:26 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:27.259548 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:27.260384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:27.274443 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:27.274928 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:27.275468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:27.276234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:27.276675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:27.277089 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:27.411376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:27.419111 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6d45dc97-3f6c-4c6d-b330-bdfbafdb5869 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.164925 Aug 31 04:07:27.419885 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 82/172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:27 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:28.081551 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:28.082202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:28.089290 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:28.089769 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:28.090193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:28.090844 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:28.091551 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:28.091997 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:28.250910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:28.259554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a945966d-ccdb-4e39-9f1d-0a5af6317b73 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1321 microversion: 2.1 time: 0.181755 Aug 31 04:07:28.260116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 91/173] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:28 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:28.441518 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:28.442163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:28.448204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:28.448649 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:28.449080 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:28.449764 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:28.450210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:28.450630 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:28.630619 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:28.642472 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6445ffc6-7336-4a91-afe7-722de535e033 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.204833 Aug 31 04:07:28.643885 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 83/174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:28 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:29.285568 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:29.286330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:29.293265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:29.293819 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:29.294359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:29.295921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:29.296528 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:29.297002 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:29.476104 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:29.485306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-53c80d69-f5ea-47ab-af3c-d03c916c8dfe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1516 microversion: 2.1 time: 0.208469 Aug 31 04:07:29.486070 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 92/175] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:29 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:29.507835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:29.510044 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:29.516909 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:29.517606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:29.518039 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:29.518734 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:29.519207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:29.519626 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:29.582367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lazy-loading 'flavor' on Instance uuid 3b9983bf-7a14-46ef-89bf-05fa2102ea35 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:07:29.665579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:29.666924 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:29.673615 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:29.674423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:29.675463 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:29.676714 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:29.677452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:29.678093 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:29.716210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6b0fa7e8-e53c-4d11-86d6-7569bd6abf06 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35/action" status: 200 len: 32 microversion: 2.1 time: 0.212231 Aug 31 04:07:29.717481 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 84/176] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:07:29 2022] POST /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:07:29.728569 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:29.729217 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:29.737291 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:29.737789 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:29.738233 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:29.739965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:29.740426 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:29.741377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:29.918381 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:29.927341 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9003565c-649b-43a8-8551-bc752c3873b5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.265759 Aug 31 04:07:29.927932 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 93/177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:29 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:29.953341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:29.970658 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9d348d05-b18f-4b91-bbad-e3e44da00519 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.246517 Aug 31 04:07:29.971472 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 85/178] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:29 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:30.949876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:30.950475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:30.957001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:30.957570 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:30.958226 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:30.958935 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:30.959433 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:30.959855 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:30.997539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:30.998192 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:31.004830 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:31.005558 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:31.005996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:31.006692 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:31.007147 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:31.007803 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:31.167426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:31.178943 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6209cebc-9c2a-43ab-88bc-861c9ddc066d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1367 microversion: 2.1 time: 0.232660 Aug 31 04:07:31.179807 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 94/179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:30 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:31.215860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:31.220001 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:31.226073 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-29e059ee-2190-4503-b4c8-6adf6482462c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.234421 Aug 31 04:07:31.227890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 86/180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:30 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:32.200279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:32.201686 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:32.208480 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:32.208952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:32.210199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:32.211128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:32.211790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:32.212292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:32.238343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:32.251182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:32.251182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:32.257867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:32.264157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:32.273670 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:32.274807 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:32.275503 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:32.279600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:32.456153 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:32.472269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cd67bb83-3ffb-45cf-a283-8efc1bc2ad0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1557 microversion: 2.1 time: 0.276269 Aug 31 04:07:32.473137 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 95/181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:32 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1557 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:32.488133 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:32.498799 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b955f555-ffbe-4948-bdba-2bc93cdc790c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.254017 Aug 31 04:07:32.500522 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 87/182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:32 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:32.517522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:32.518021 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:32.524016 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:32.524640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:32.525079 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:32.525777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:32.526292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:32.526649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:32.622521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7e17111f-cb1b-40cc-955f-3124d74b3e24 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116770 Aug 31 04:07:32.623252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 96/183] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 31 04:07:32 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:33.497254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:33.497728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:33.504605 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:33.505144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:33.512758 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:33.513610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:33.514153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:33.514516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:33.524244 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:33.525650 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:33.536576 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:33.537356 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:33.538005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:33.539823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:33.540514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:33.545960 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:33.547446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:07:33.751115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a390fd08-38ee-4df7-bcdc-74ea1e076b7d tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 204 len: 0 microversion: 2.1 time: 0.257580 Aug 31 04:07:33.752287 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 88/184] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:07:33 2022] DELETE /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:07:33.760688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:33.761862 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:33.770342 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:33.771889 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:33.772551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:33.773494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:33.774150 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:33.774786 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:34.178430 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:34.191453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4ef7aa96-9875-4d37-9b9c-0919ff6538da tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.671057 Aug 31 04:07:34.193364 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 97/185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:33 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:34.199785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-02abbc87-4e9d-4a1c-810f-9f48797708d7 req-cbbb3b71-2f76-4c48-805d-2401e0f3ac2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5504b0-52b4-4d1a-a67b-6d6e26053371", "tag": "55988fa5-eb1f-435f-ba39-34e32cd7d071"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:34.207920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:34.211735 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-02abbc87-4e9d-4a1c-810f-9f48797708d7 req-cbbb3b71-2f76-4c48-805d-2401e0f3ac2e service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:34.212662 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-02abbc87-4e9d-4a1c-810f-9f48797708d7 req-cbbb3b71-2f76-4c48-805d-2401e0f3ac2e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:34.213418 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-02abbc87-4e9d-4a1c-810f-9f48797708d7 req-cbbb3b71-2f76-4c48-805d-2401e0f3ac2e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:34.227717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1fb6aca4-8336-4b45-bde7-6e918285ee89 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1555 microversion: 2.1 time: 0.466694 Aug 31 04:07:34.227717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 89/186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:33 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1555 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:34.240062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-02abbc87-4e9d-4a1c-810f-9f48797708d7 req-cbbb3b71-2f76-4c48-805d-2401e0f3ac2e service nova] Creating event network-changed:55988fa5-eb1f-435f-ba39-34e32cd7d071 for instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 on hv-cinder-85391 Aug 31 04:07:34.247274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-02abbc87-4e9d-4a1c-810f-9f48797708d7 req-cbbb3b71-2f76-4c48-805d-2401e0f3ac2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050380 Aug 31 04:07:34.247521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 98/187] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:35.213528 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:35.214346 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:35.220879 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:35.221370 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:35.221806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:35.222498 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:35.222964 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:35.223412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:35.246596 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:35.248001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:35.255413 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:35.256231 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:35.256813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:35.257758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:35.258309 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:35.259003 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:35.609918 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:35.635487 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4979491d-023e-4cff-9d24-8589d0eca9bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.425291 Aug 31 04:07:35.652509 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 90/188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:35 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:35.699832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:35.714463 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a0a9148c-ea63-4c3a-9eec-b94285b5595b tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1555 microversion: 2.1 time: 0.472152 Aug 31 04:07:35.719208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 99/189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:35 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1555 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:36.660922 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:36.662247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:36.668705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:36.669607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:36.670735 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:36.671608 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:36.672271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:36.672909 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:36.738232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:36.739369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:36.746541 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:36.747159 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:36.747661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:36.748892 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:36.749571 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:36.750229 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:37.297706 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:37.305883 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-70d7c569-29d4-4788-8a35-1e79f38d8ee9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.648631 Aug 31 04:07:37.306472 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 91/190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:36 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:37.383447 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:37.392668 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-15fbd704-6471-45e5-824d-3aa7f9ee8820 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1555 microversion: 2.1 time: 0.658424 Aug 31 04:07:37.393260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 100/191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:36 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1555 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:37.625533 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-bb1d2ab4-3bb8-4762-aff4-c9a3c443f796 req-f74c0b25-cf41-4275-ad30-30bfcf00684c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5844439f-0f36-44bf-8d44-f7c95e7954c4", "name": "network-vif-deleted", "tag": "c70b840e-d3e2-4644-b547-1b19ffa1be8d"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:37.644535 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-bb1d2ab4-3bb8-4762-aff4-c9a3c443f796 req-f74c0b25-cf41-4275-ad30-30bfcf00684c service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:37.645677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-bb1d2ab4-3bb8-4762-aff4-c9a3c443f796 req-f74c0b25-cf41-4275-ad30-30bfcf00684c service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:37.646342 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-bb1d2ab4-3bb8-4762-aff4-c9a3c443f796 req-f74c0b25-cf41-4275-ad30-30bfcf00684c service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:37.660927 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-bb1d2ab4-3bb8-4762-aff4-c9a3c443f796 req-f74c0b25-cf41-4275-ad30-30bfcf00684c service nova] Creating event network-vif-deleted:c70b840e-d3e2-4644-b547-1b19ffa1be8d for instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 on hv-cinder-85391 Aug 31 04:07:37.666748 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-bb1d2ab4-3bb8-4762-aff4-c9a3c443f796 req-f74c0b25-cf41-4275-ad30-30bfcf00684c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047174 Aug 31 04:07:37.667461 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 92/192] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:38.335052 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:38.335639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:38.342782 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:38.343329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:38.343749 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:38.344474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:38.344925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:38.345357 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:38.415508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:38.416970 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:38.425395 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:38.425888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:38.426318 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:38.427223 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:38.427946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:38.428535 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:38.462662 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:38.463181 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:38.463783 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:38.464229 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lazy-loading 'fault' on Instance uuid 5844439f-0f36-44bf-8d44-f7c95e7954c4 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:07:38.526949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7103b8b46630401889a8e040c0e9ad62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfea8632ec6f4cb5ac84e58d4fe10e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:38.537129 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ec281bbb-8fc7-42b4-98ab-6b9f4b0dba73 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 200 len: 1351 microversion: 2.1 time: 0.126827 Aug 31 04:07:38.537726 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 93/193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:38 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:38.567232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:38.574483 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9368b550-c230-464d-968f-ba29d19e92bd tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.243208 Aug 31 04:07:38.578461 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 101/194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:38 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:39.559637 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:39.560337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:39.566730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:39.567227 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:39.567693 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:39.568337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:39.568816 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:39.569228 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:39.584123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] HTTP exception thrown: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Request method failure captured: Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 HTTP/1.1 Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5D3paowyVXKdwO6T_KQthknrQ_Q-3xKo-jCDhggpiYx76jgcav1FLedrcH0IirJUP-8Vr2OasiyHB082dNA72WVCGAAdS7FqYV3gcdslITOimZhSr6sl_GiSUsixlc4u1p8woGtT14nENWgriDGM3i-7DKnRXZwQbLHB-dXjGlg68 Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: dfea8632ec6f4cb5ac84e58d4fe10e6a Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:07:39.588842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfea8632ec6f4cb5ac84e58d4fe10e6a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: dfea8632ec6f4cb5ac84e58d4fe10e6a Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-DeleteServersTestJSON-1084550576-project Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 7103b8b46630401889a8e040c0e9ad62 Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-DeleteServersTestJSON-1084550576-project Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.590230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '5844439f-0f36-44bf-8d44-f7c95e7954c4'} Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:07:39.590935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.592210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.593272 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Returning 404 to user: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:07:39.593272 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c0c2d9c0-70b8-42d1-b2dc-dbe15d717e26 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 404 len: 111 microversion: 2.1 time: 0.034650 Aug 31 04:07:39.593272 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 94/195] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:39 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:07:39.599265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:39.599881 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:39.610474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:39.611083 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:39.611691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:39.612919 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:39.614343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:39.615064 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:39.714763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:39.717069 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:39.724874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:39.725387 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:39.725828 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:39.726557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:39.727003 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:39.727636 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:39.743359 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] HTTP exception thrown: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Request method failure captured: Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4/os-volume_attachments HTTP/1.1 Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5D3paowyVXKdwO6T_KQthknrQ_Q-3xKo-jCDhggpiYx76jgcav1FLedrcH0IirJUP-8Vr2OasiyHB082dNA72WVCGAAdS7FqYV3gcdslITOimZhSr6sl_GiSUsixlc4u1p8woGtT14nENWgriDGM3i-7DKnRXZwQbLHB-dXjGlg68 Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: dfea8632ec6f4cb5ac84e58d4fe10e6a Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:07:39.744950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfea8632ec6f4cb5ac84e58d4fe10e6a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: dfea8632ec6f4cb5ac84e58d4fe10e6a Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-DeleteServersTestJSON-1084550576-project Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 7103b8b46630401889a8e040c0e9ad62 Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-DeleteServersTestJSON-1084550576-project Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.746407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'server_id': '5844439f-0f36-44bf-8d44-f7c95e7954c4'} Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:07:39.747110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:39.749288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:07:39.751578 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Returning 404 to user: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:07:39.751578 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-438e6e3d-3115-4a73-af25-e1483e328e7c tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035944 Aug 31 04:07:39.751578 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 95/196] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:07:39 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:07:39.785860 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:39.803736 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca3c9176-0284-49a9-ac25-38e370efcd4f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.208780 Aug 31 04:07:39.824361 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 102/197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:39 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:40.830001 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:40.830593 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:40.837269 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:40.837754 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:40.838190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:40.838881 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:40.839366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:40.839795 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:40.981584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:40.982654 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:40.994481 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:40.994642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:40.995130 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:40.995766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:40.996695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:40.997434 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:40.997980 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:41.003443 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c2c36494-ab10-46fc-bce7-ee2a8763973d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.177335 Aug 31 04:07:41.004019 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 96/198] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:40 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:41.008786 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-742822009", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "networks": [{"uuid": "f3daff5e-9e3d-4999-a212-86ec6d078ed2"}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:41.013743 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] HTTP exception thrown: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Request method failure captured: Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 HTTP/1.1 Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5D3paowyVXKdwO6T_KQthknrQ_Q-3xKo-jCDhggpiYx76jgcav1FLedrcH0IirJUP-8Vr2OasiyHB082dNA72WVCGAAdS7FqYV3gcdslITOimZhSr6sl_GiSUsixlc4u1p8woGtT14nENWgriDGM3i-7DKnRXZwQbLHB-dXjGlg68 Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: dfea8632ec6f4cb5ac84e58d4fe10e6a Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:07:41.019462 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfea8632ec6f4cb5ac84e58d4fe10e6a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: dfea8632ec6f4cb5ac84e58d4fe10e6a Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-DeleteServersTestJSON-1084550576-project Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 7103b8b46630401889a8e040c0e9ad62 Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-DeleteServersTestJSON-1084550576-project Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.020661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '5844439f-0f36-44bf-8d44-f7c95e7954c4'} Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:07:41.021306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.022443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.024681 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Returning 404 to user: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:07:41.025587 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3278a27b-5d3d-41ed-bb99-9037b90ce458 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 404 len: 111 microversion: 2.1 time: 0.048638 Aug 31 04:07:41.026155 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 103/199] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:07:40 2022] DELETE /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:07:41.034815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:41.035593 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] [instance: 5844439f-0f36-44bf-8d44-f7c95e7954c4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:41.042624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:41.043445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:41.044074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:41.045293 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:41.045920 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:41.046513 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:41.062156 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] HTTP exception thrown: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Request method failure captured: Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 HTTP/1.1 Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5D3paowyVXKdwO6T_KQthknrQ_Q-3xKo-jCDhggpiYx76jgcav1FLedrcH0IirJUP-8Vr2OasiyHB082dNA72WVCGAAdS7FqYV3gcdslITOimZhSr6sl_GiSUsixlc4u1p8woGtT14nENWgriDGM3i-7DKnRXZwQbLHB-dXjGlg68 Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: dfea8632ec6f4cb5ac84e58d4fe10e6a Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:07:41.063793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfea8632ec6f4cb5ac84e58d4fe10e6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfea8632ec6f4cb5ac84e58d4fe10e6a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: dfea8632ec6f4cb5ac84e58d4fe10e6a Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-DeleteServersTestJSON-1084550576 Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-DeleteServersTestJSON-1084550576-project Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 7103b8b46630401889a8e040c0e9ad62 Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-DeleteServersTestJSON-1084550576-project Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.064965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '5844439f-0f36-44bf-8d44-f7c95e7954c4'} Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:07:41.065998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. Aug 31 04:07:41.068193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:07:41.069115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] Returning 404 to user: Instance 5844439f-0f36-44bf-8d44-f7c95e7954c4 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:07:41.069115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4ae494eb-f6f3-4ef2-9378-c4d8e1059ca5 tempest-DeleteServersTestJSON-1084550576 tempest-DeleteServersTestJSON-1084550576-project] 10.222.0.18 "GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4" status: 404 len: 111 microversion: 2.1 time: 0.034932 Aug 31 04:07:41.069115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 104/200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:41 2022] GET /compute/v2.1/servers/5844439f-0f36-44bf-8d44-f7c95e7954c4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:07:41.070163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] validate_networks() for [('f3daff5e-9e3d-4999-a212-86ec6d078ed2', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:07:42.009775 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:07:42.010976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:07:42.011475 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:07:42.011879 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:07:42.012280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:07:42.026024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:42.027530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:42.030027 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:42.030998 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:42.031655 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:42.032551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:42.033205 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:42.033762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:42.034682 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:42.035477 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:42.035913 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:42.036602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:42.037158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:42.038154 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:42.057851 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Getting quotas for project d362e24b36234e6b9a62f07a06dcd9f3. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:07:42.063449 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Getting quotas for user ffdeb3e2f0ec411682815e1d4197f662 and project d362e24b36234e6b9a62f07a06dcd9f3. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:07:42.076287 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:07:42.079222 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:07:42.128020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5142d947-38d7-4bd8-a9ff-271488df6f34 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122594 Aug 31 04:07:42.128889 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 97/201] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:07:42.139483 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-90f6b06d-4615-47bd-a5ed-4a4bcd22396c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:42.140080 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-90f6b06d-4615-47bd-a5ed-4a4bcd22396c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:42.513054 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-90f6b06d-4615-47bd-a5ed-4a4bcd22396c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:42.521811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-90f6b06d-4615-47bd-a5ed-4a4bcd22396c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1218 microversion: 2.1 time: 0.386225 Aug 31 04:07:42.522565 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 98/202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:42 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1218 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:42.682363 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:42.691332 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f0dc36b1-0269-4214-8924-5a331d78f54b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.670647 Aug 31 04:07:42.705689 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 105/203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:42 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:43.548494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:43.549700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:43.557413 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:43.558243 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:43.558979 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:43.559889 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:43.560621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:43.561218 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:43.712529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:43.713739 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:43.724673 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:43.727520 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:43.728252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:43.729773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:43.730705 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:43.731227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:43.745830 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:43.754891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-38501dc7-7960-45be-93d1-d02373ff5318 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1278 microversion: 2.1 time: 0.215418 Aug 31 04:07:43.772381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 99/204] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:43 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:44.104065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:44.112682 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9ee456d5-1a1b-4b59-8b37-6ba8a2ca6610 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.404259 Aug 31 04:07:44.113232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 106/205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:43 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:44.780428 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:44.781824 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:44.793355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:44.797175 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:44.797815 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:44.798756 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:44.799450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:44.802491 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:45.133332 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:45.134055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:45.135560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:45.144012 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f4ecea87-ccf4-46ea-96bf-219b4695334b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1318 microversion: 2.1 time: 0.367903 Aug 31 04:07:45.144809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 100/206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:44 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:45.157366 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:45.157851 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:45.162190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:45.163316 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:45.163942 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:45.164427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:45.472910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:45.492490 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7e21738e-2c50-40ca-ade5-066b6d8f77e3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.362223 Aug 31 04:07:45.492892 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 107/207] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:45 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:46.170244 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:46.170926 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:46.178700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:46.180210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:46.183068 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:46.183890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:46.184446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:46.185009 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:46.512662 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:46.514091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:46.521475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:46.523277 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:46.523947 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:46.524895 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:46.525552 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:46.526384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:46.574146 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:46.586140 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-cb7a4816-f1d0-4e84-b0ab-fdb5a3db8370 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1318 microversion: 2.1 time: 0.419914 Aug 31 04:07:46.587546 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 101/208] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:46 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:46.812242 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-655f8851-5ddb-4c1e-b083-af50bf17d30f req-a86efd4d-a2da-41f7-b351-20af6099315e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02ea746-4312-45b9-9df2-9e9ef4279ca9", "tag": "6a5ae5f2-2c6e-46a2-a11e-9bfa01e50e69"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:46.830650 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-655f8851-5ddb-4c1e-b083-af50bf17d30f req-a86efd4d-a2da-41f7-b351-20af6099315e service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:46.837833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-655f8851-5ddb-4c1e-b083-af50bf17d30f req-a86efd4d-a2da-41f7-b351-20af6099315e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:46.838283 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-655f8851-5ddb-4c1e-b083-af50bf17d30f req-a86efd4d-a2da-41f7-b351-20af6099315e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:46.854513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-655f8851-5ddb-4c1e-b083-af50bf17d30f req-a86efd4d-a2da-41f7-b351-20af6099315e service nova] Creating event network-changed:6a5ae5f2-2c6e-46a2-a11e-9bfa01e50e69 for instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 on hv-cinder-85391 Aug 31 04:07:46.860551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-655f8851-5ddb-4c1e-b083-af50bf17d30f req-a86efd4d-a2da-41f7-b351-20af6099315e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052512 Aug 31 04:07:46.861460 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 102/209] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:46.951059 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:46.959055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bc83551b-6dbb-443a-9374-a780561b848c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.450220 Aug 31 04:07:46.973183 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 108/210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:46 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:47.608899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:47.609600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:47.619843 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:47.620338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:47.620776 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:47.621472 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:47.621925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:47.622376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:47.803820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:47.816859 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8e34ecec-f3ce-4d5f-b609-84d20ba34229 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1318 microversion: 2.1 time: 0.213065 Aug 31 04:07:47.817622 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 103/211] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:47 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:47.983268 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:47.983933 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:47.990815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:47.993235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:47.995167 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:47.999103 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:47.999589 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:48.000028 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:48.179328 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:48.187395 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-67f8874e-4280-4880-bcbb-735edca91b42 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.211143 Aug 31 04:07:48.187970 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 109/212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:47 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:48.837910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:48.838556 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:48.845012 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:48.845454 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:48.846079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:48.846955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:48.847569 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:48.848265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:49.094295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:49.103967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6a400019-6683-44e9-af5f-9ef86ad784eb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1318 microversion: 2.1 time: 0.269937 Aug 31 04:07:49.104763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 104/213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:48 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:49.208762 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:49.209607 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:49.222788 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:49.223434 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:49.225228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:49.226356 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:49.227336 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:49.228065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:49.558877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:49.575770 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-19dd510f-2325-49c9-bd6b-af8f4b931a4a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.370975 Aug 31 04:07:49.576183 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 110/214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:49 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:50.126744 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:50.127348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:50.133338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:50.133816 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:50.134239 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:50.134917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:50.135387 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:50.135799 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:50.333384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:50.337657 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:50.348397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0fb0920d-8a1d-461c-934f-acf15830fe43 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1318 microversion: 2.1 time: 0.225897 Aug 31 04:07:50.349083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 105/215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:50 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:50.425403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ed0c5342-8078-4d04-a304-3663f010e1ed tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad5870d0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:50.485407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ed0c5342-8078-4d04-a304-3663f010e1ed tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/44e240c0-808a-4ee8-b4cd-9fe7d67c31e3" status: 200 len: 350 microversion: 2.1 time: 0.064490 Aug 31 04:07:50.486579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 111/216] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:07:50 2022] GET /compute/v2.1/os-volumes/44e240c0-808a-4ee8-b4cd-9fe7d67c31e3 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:50.601995 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:50.602967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:50.613835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:50.614519 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:50.615759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:50.616937 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:50.617630 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:50.618968 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:50.812591 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:50.824676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-cd7e7583-6f68-42b5-a878-5b02574ab15a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.230983 Aug 31 04:07:50.835737 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 106/217] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:50 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:51.369689 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:51.370284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:51.376827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:51.377545 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:51.378151 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:51.379003 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:51.379633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:51.380204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:51.562380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:51.572394 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cd415b9b-8d30-41b4-a5e2-69a94ba9d327 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1318 microversion: 2.1 time: 0.206019 Aug 31 04:07:51.573210 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 112/218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:51 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:51.625091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-29f224c1-1b7c-4f1b-82f2-492bd3a3bc79 req-4bfbcc8b-5e0d-4516-9829-48427bb05add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02ea746-4312-45b9-9df2-9e9ef4279ca9", "name": "network-vif-plugged", "status": "completed", "tag": "6a5ae5f2-2c6e-46a2-a11e-9bfa01e50e69"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:07:51.635121 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-29f224c1-1b7c-4f1b-82f2-492bd3a3bc79 req-4bfbcc8b-5e0d-4516-9829-48427bb05add service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:51.635838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-29f224c1-1b7c-4f1b-82f2-492bd3a3bc79 req-4bfbcc8b-5e0d-4516-9829-48427bb05add service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:51.636356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-29f224c1-1b7c-4f1b-82f2-492bd3a3bc79 req-4bfbcc8b-5e0d-4516-9829-48427bb05add service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:51.649813 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-29f224c1-1b7c-4f1b-82f2-492bd3a3bc79 req-4bfbcc8b-5e0d-4516-9829-48427bb05add service nova] Creating event network-vif-plugged:6a5ae5f2-2c6e-46a2-a11e-9bfa01e50e69 for instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 on hv-cinder-85391 Aug 31 04:07:51.656221 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-29f224c1-1b7c-4f1b-82f2-492bd3a3bc79 req-4bfbcc8b-5e0d-4516-9829-48427bb05add service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035412 Aug 31 04:07:51.657393 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 107/219] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:51.847556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:51.848381 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:51.856969 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:51.857460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:51.858053 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:51.858755 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:51.859266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:51.859768 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:51.996663 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d7adc648-a62d-4060-ba68-acf20f09f4b7 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad58e8b0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:52.046112 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:52.057417 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:52.066429 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d7adc648-a62d-4060-ba68-acf20f09f4b7 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/30f24bd9-2cad-43ec-88e3-bfa94e83e892" status: 200 len: 350 microversion: 2.1 time: 0.073798 Aug 31 04:07:52.066580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6896fd20-b2e3-4ee3-a139-3e07e9ce0a56 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.223770 Aug 31 04:07:52.067197 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 113/220] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:51 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:52.067887 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 108/221] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:07:51 2022] GET /compute/v2.1/os-volumes/30f24bd9-2cad-43ec-88e3-bfa94e83e892 => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:07:52.593900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:52.594515 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:52.601298 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:52.601801 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:52.602410 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:52.603237 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:52.603706 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:52.604132 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:52.753049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:52.761291 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-077d76c8-14d9-44c7-9bd2-4a1ccf52df9c tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1318 microversion: 2.1 time: 0.171535 Aug 31 04:07:52.761863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 114/222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:52 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:53.085003 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=8 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:53.089271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:53.090039 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:53.096906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:53.097376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:53.097826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:53.098514 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:53.098944 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:53.099382 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:53.235644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:53.243730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bacf5c2d-08b7-439c-9349-4513f44d9ca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.159427 Aug 31 04:07:53.244315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 109/223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:53 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:53.474512 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0df4c1ba-e932-4aaf-8307-a4b762dd45b2 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad47e3a0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:53.525979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0df4c1ba-e932-4aaf-8307-a4b762dd45b2 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/41728198-0b4d-4950-a17b-9173404e403b" status: 200 len: 349 microversion: 2.1 time: 0.055209 Aug 31 04:07:53.526558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 115/224] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 31 04:07:53 2022] GET /compute/v2.1/os-volumes/41728198-0b4d-4950-a17b-9173404e403b => generated 349 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:53.539596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b6f26476-64b0-4596-97e1-af2119237cfb tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad4420d0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:53.627397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b6f26476-64b0-4596-97e1-af2119237cfb tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.092108 Aug 31 04:07:53.627971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 110/225] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Aug 31 04:07:53 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:53.642747 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7cc446f5-0d32-4f40-944d-ab41d81a1ab9 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad4808b0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:53.733640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7cc446f5-0d32-4f40-944d-ab41d81a1ab9 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.096109 Aug 31 04:07:53.734224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 116/226] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Aug 31 04:07:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:07:53.748065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-84689ca3-865d-4d68-8cc5-d79b8cf300cb tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad4988b0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:53.783634 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:53.784665 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:53.792958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:53.793437 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:53.793861 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:53.794623 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:53.795090 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:53.796054 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:53.805835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:53.834708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-84689ca3-865d-4d68-8cc5-d79b8cf300cb tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.090589 Aug 31 04:07:53.835323 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 111/227] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Aug 31 04:07:53 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:53.848371 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-79f9e12b-be58-4ed3-a4c4-fdb709ac7cac tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad436d30>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:53.935534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:53.937303 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-79f9e12b-be58-4ed3-a4c4-fdb709ac7cac tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092828 Aug 31 04:07:53.938188 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 112/228] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Aug 31 04:07:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:07:53.943967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6e0342bc-00e9-4c08-9f86-0248ca5c60bc tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1318 microversion: 2.1 time: 0.164450 Aug 31 04:07:53.944518 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 117/229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:53 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:07:53.959451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5ba7cae5-bf56-4bf5-bdb8-db03c28d77f3 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad498d30>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:54.057644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5ba7cae5-bf56-4bf5-bdb8-db03c28d77f3 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.101859 Aug 31 04:07:54.058453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 113/230] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Aug 31 04:07:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:54.071988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f3a4a4d3-c1ff-4f74-bb8f-375bcd4e5bfd tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad5871f0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:54.174711 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f3a4a4d3-c1ff-4f74-bb8f-375bcd4e5bfd tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.106720 Aug 31 04:07:54.175347 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 118/231] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Aug 31 04:07:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:54.189321 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0c2c93de-3a6c-4f7f-888e-a2cffb4d4b6e tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad62f5e0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:54.266404 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:54.267074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:54.273313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:54.273789 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:54.274216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:54.274896 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:54.275373 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:54.275791 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:54.278240 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0c2c93de-3a6c-4f7f-888e-a2cffb4d4b6e tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093516 Aug 31 04:07:54.278922 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 114/232] 10.222.0.18 () {58 vars in 1188 bytes} [Wed Aug 31 04:07:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:07:54.291872 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1a7d2b0e-2ff7-45b5-8475-b7f55b4922e0 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] Calling method '.version_select at 0x7f88ad433820>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:54.376050 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1a7d2b0e-2ff7-45b5-8475-b7f55b4922e0 tempest-VolumesTestJSON-825862946 tempest-VolumesTestJSON-825862946-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.087848 Aug 31 04:07:54.376616 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 115/233] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Aug 31 04:07:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:54.412216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:54.421630 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b4ad32a6-b461-4537-ad17-06395942f27c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.159616 Aug 31 04:07:54.422336 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 119/234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:54 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:54.964185 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:54.965021 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:54.968182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:54.971942 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:54.972355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:54.972779 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:54.973692 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:54.973976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:54.974537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:55.133393 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:55.141578 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e0413197-2b40-4c71-b7c8-f40994bc7ed0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1508 microversion: 2.1 time: 0.181320 Aug 31 04:07:55.142541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 116/235] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:54 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:55.444620 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:55.445229 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:55.447948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=56 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:55.454584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:55.455565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:55.455565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:55.456226 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:55.456684 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:55.457150 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:55.652260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:55.663525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca294697-e3d8-4b2c-8760-75c40a7b9bb1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.222914 Aug 31 04:07:55.664300 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 120/236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:55 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:56.685571 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:56.686181 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:56.705207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:56.706634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:56.707355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:56.710067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:56.711284 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:56.713623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:56.981328 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:56.992863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-72f2f74c-17fd-4e90-99bc-bf8f6cba91a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.311641 Aug 31 04:07:56.995398 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 117/237] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:56 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:58.025058 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:58.025841 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:58.049882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:58.050384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:58.050832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:58.051565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:58.052022 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:58.052450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:58.316182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:58.331074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-78997186-b1c5-4c24-a53d-1027a96d68a5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.312165 Aug 31 04:07:58.332145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 121/238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:58 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:07:59.352760 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:07:59.353381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:07:59.362833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:59.364593 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:59.365346 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:59.366240 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:07:59.367870 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:07:59.368383 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:07:59.548700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:07:59.557209 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d6f4dd3c-c0d4-415e-bd7d-a9cc0b840d02 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.208153 Aug 31 04:07:59.559847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 118/239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:07:59 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:00.578801 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:00.580686 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:00.590877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:00.592045 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:00.592505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:00.593187 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:00.593642 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:00.594072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:00.751540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:00.760610 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b378798c-ea43-4f4b-9d16-9af27b79e331 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.186826 Aug 31 04:08:00.761192 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 122/240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:00 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:01.781703 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:01.782470 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:01.788821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:01.789314 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:01.789747 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:01.790448 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:01.790898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:01.791366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:01.944223 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:01.961364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1a3cd325-5a69-4a29-bf2e-76d6859cc543 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.183379 Aug 31 04:08:01.962159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 119/241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:01 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:02.984379 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:02.985027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:02.993215 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:02.993978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:02.994556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:02.995343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:02.995787 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:02.996197 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:03.187499 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:03.195690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-92f12d5b-4c49-4506-b6e5-b0aeeeeddc45 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.217104 Aug 31 04:08:03.209500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 123/242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:02 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:03.951045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-942543558", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:04.016696 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] validate_networks() for None {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:08:04.219082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:04.219810 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:04.230194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:04.232464 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:04.233386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:04.234786 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:04.235358 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:04.236130 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:04.665906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:08:04.666829 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:08:04.668437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:08:04.669077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:08:04.669674 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:08:04.680601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:04.681077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:04.681499 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:04.682206 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:04.682823 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:04.683273 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:04.694062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:04.701081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Getting quotas for project 4dceffdfa7224a4a84be50c94c6f3d4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:08:04.703230 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a1259f06-75db-429b-aec2-0c1f374fa63d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.490297 Aug 31 04:08:04.704135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 124/243] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:04 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:04.706218 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Getting quotas for user 3fa26512830547db839cea342721da4b and project 4dceffdfa7224a4a84be50c94c6f3d4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:08:04.718381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:08:04.720731 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:08:04.769767 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-50760e3a-a24e-464b-8f14-270e8ca7e6eb tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822807 Aug 31 04:08:04.776146 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 120/244] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:08:04.782276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8b57b71b-a20c-46e8-8e44-b0a60f3bba56 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:04.782971 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8b57b71b-a20c-46e8-8e44-b0a60f3bba56 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:04.839665 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8b57b71b-a20c-46e8-8e44-b0a60f3bba56 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:04.848118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8b57b71b-a20c-46e8-8e44-b0a60f3bba56 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1214 microversion: 2.1 time: 0.070562 Aug 31 04:08:04.848752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 125/245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:04 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:05.725659 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:05.726488 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:05.733873 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:05.734485 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:05.735082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:05.736120 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:05.736769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:05.737633 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:05.869160 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:05.870469 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:05.878975 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:05.879488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:05.879924 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:05.880675 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:05.881307 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:05.881737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:05.986448 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:05.995680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:05.999818 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-23621860-5f89-4dec-bd8e-9b9baf909b91 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1266 microversion: 2.1 time: 0.134122 Aug 31 04:08:06.002018 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 126/246] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:05 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:06.007308 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-36555fbb-fd30-4d43-908a-f5bdade52065 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.286123 Aug 31 04:08:06.011726 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 121/247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:05 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:07.031750 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:07.033601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:07.033805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:07.035400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:07.051309 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:07.052023 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:07.053364 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:07.053642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:07.054203 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:07.054858 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:07.055841 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:07.056300 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:07.056726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:07.061232 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:07.061716 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:07.062153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:07.216564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:07.229176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c26b135c-22ac-418c-9b3c-79904725da3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1272 microversion: 2.1 time: 0.207809 Aug 31 04:08:07.229637 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 127/248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:07 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:07.390701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:07.391232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:07.399806 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:07.401286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:07.402100 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:07.403405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:07.404215 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:07.405194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:07.427238 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:07.440188 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bbd1d4d8-40b7-47aa-8d71-3326ce03368d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.415362 Aug 31 04:08:07.444703 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 122/249] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:07 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:07.482478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-00ace285-aeb5-4e0a-94f2-99a615292199 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/ips" status: 200 len: 151 microversion: 2.20 time: 0.096836 Aug 31 04:08:07.487561 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 128/250] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Aug 31 04:08:07 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/ips => generated 151 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:08:08.252416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:08.253024 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:08.261089 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:08.261577 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:08.262010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:08.262816 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:08.263341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:08.263765 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:08.466672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:08.468049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:08.468380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:08.477740 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:08.479156 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:08.479841 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:08.480076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f6a46455-8ca5-4953-bb38-b0c61dccaa82 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.231522 Aug 31 04:08:08.493338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 123/251] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:08 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:08.495778 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:08.496427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:08.496936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:08.559939 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-73e176bd-1964-4083-bd8a-1a51f01f15fc req-216ef38c-b5f0-4a4c-a2d7-37d637a85a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f84ef0-d99a-45a9-8374-94bdab970c84", "tag": "c1ca18a0-1ccb-4a55-ae54-f591b51f8fa3"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:08.574614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-73e176bd-1964-4083-bd8a-1a51f01f15fc req-216ef38c-b5f0-4a4c-a2d7-37d637a85a01 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:08.575113 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-73e176bd-1964-4083-bd8a-1a51f01f15fc req-216ef38c-b5f0-4a4c-a2d7-37d637a85a01 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:08.575901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-73e176bd-1964-4083-bd8a-1a51f01f15fc req-216ef38c-b5f0-4a4c-a2d7-37d637a85a01 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:08.589820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-73e176bd-1964-4083-bd8a-1a51f01f15fc req-216ef38c-b5f0-4a4c-a2d7-37d637a85a01 service nova] Creating event network-changed:c1ca18a0-1ccb-4a55-ae54-f591b51f8fa3 for instance f3f84ef0-d99a-45a9-8374-94bdab970c84 on hv-cinder-85391 Aug 31 04:08:08.595437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-73e176bd-1964-4083-bd8a-1a51f01f15fc req-216ef38c-b5f0-4a4c-a2d7-37d637a85a01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048632 Aug 31 04:08:08.596514 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 124/252] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:08:08.773985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:08.783205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-daf180c3-594d-4366-bd60-d6d59c417e2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.322413 Aug 31 04:08:08.784439 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 129/253] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:08 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:09.502014 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:09.502723 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:09.509129 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:09.509818 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:09.510279 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:09.510980 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:09.511462 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:09.511952 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:09.669075 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:09.677618 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d4b0af49-0291-4cf1-8c72-0e7c9bc2f6cf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.180197 Aug 31 04:08:09.678394 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 125/254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:09 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:09.807170 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:09.808436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:09.816914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:09.817312 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:09.817752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:09.818454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:09.818916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:09.820594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:09.991872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:10.001135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-295aa742-ef03-4804-a6f9-5eef6468b343 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.198666 Aug 31 04:08:10.001898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 130/255] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:09 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:10.698408 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:10.699012 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:10.705610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:10.706290 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:10.706726 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:10.707453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:10.707902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:10.708478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:10.855159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:10.867145 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-fff7bd9a-68df-4844-bc53-0af1edb8d285 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.172468 Aug 31 04:08:10.868361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 126/256] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:10 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:11.023177 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:11.023790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:11.030621 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:11.031122 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:11.031568 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:11.034465 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:11.034465 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:11.034465 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:11.173114 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:11.182374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-048bf770-bbcb-4d52-8480-20eefc3a9906 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.163205 Aug 31 04:08:11.182985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 131/257] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:11 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:11.230347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:11.230983 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:11.237358 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:11.238027 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:11.238932 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:11.239731 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:11.240252 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:11.240710 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:11.411896 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lazy-loading 'flavor' on Instance uuid 675abe1e-ac1e-458b-b5ac-745a7f6917b7 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:08:11.594081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0709591f-e3b2-4c62-93d1-1f6e7fee35cb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/action" status: 202 len: 0 microversion: 2.20 time: 0.367544 Aug 31 04:08:11.594851 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 127/258] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 31 04:08:11 2022] POST /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:08:11.603400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:11.604073 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:11.610132 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:11.610692 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:11.611226 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:11.611967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:11.615785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:11.615785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:11.756441 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:11.765216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:11.766789 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:11.767974 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-21ee9bdd-92f4-45c2-bd65-4a662618bb23 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.168846 Aug 31 04:08:11.768536 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 132/259] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:11 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:08:11.891135 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:11.892027 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:11.899947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:11.900437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:11.900892 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:11.901705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:11.905386 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:11.905840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:12.042203 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:12.053369 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e1eb3118-c497-4b51-839f-657f8abeaeaf tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.165136 Aug 31 04:08:12.053369 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 128/260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:11 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:12.204656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:12.205270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:12.212460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:12.213204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:12.213638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:12.214339 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:12.214845 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:12.215316 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:12.375958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:12.384095 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-15224f09-016a-4855-9dc3-66e828338599 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.184364 Aug 31 04:08:12.384864 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 133/261] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:12 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:12.792516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:12.793127 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:12.813420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:12.813936 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:12.814361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:12.815152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:12.815673 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:12.816280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:12.835290 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:12.955487 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:12.964569 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:12.966045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:12.967590 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-fd805e4d-e73e-4189-9cec-6d90a2f8bd53 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.179659 Aug 31 04:08:12.968147 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 129/262] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:12 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:13.071187 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:13.071823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:13.077843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:13.078319 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:13.078745 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:13.079487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:13.080017 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:13.080490 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:13.288757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:13.298405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0ebbd427-96f4-402b-8a60-a795cb7f642e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.230968 Aug 31 04:08:13.299223 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 134/263] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:13 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:13.405037 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:13.405648 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:13.414058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:13.414969 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:13.415486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:13.416546 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:13.417007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:13.417438 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:13.603920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:13.612244 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5f26180b-634e-48f8-923d-95d72d31e4c0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.211135 Aug 31 04:08:13.612826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 130/264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:13 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:13.992679 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:13.993267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:13.999514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:13.999991 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:14.000416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:14.001123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:14.001790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:14.002193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:14.176337 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:14.188387 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:14.190277 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:14.193590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-27b57867-dd3f-4f7f-b8f5-401091380f1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.203841 Aug 31 04:08:14.194190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 135/265] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:13 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:14.320831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:14.321417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:14.328626 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:14.329264 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:14.329939 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:14.330878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:14.331411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:14.332059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:14.578592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:14.589354 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-70f265d3-7e03-4505-8169-d729c7807a4e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.273128 Aug 31 04:08:14.591720 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 131/266] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:14 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:14.636041 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:14.636656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:14.643270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:14.643750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:14.644183 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:14.644906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:14.645485 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:14.645793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:14.649812 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:14.847520 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:14.926105 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:14.934013 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-68bcd936-333d-433d-a62c-11b348b88162 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.302132 Aug 31 04:08:14.934590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 136/267] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:14 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:15.217652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:15.218281 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:15.220265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:15.220861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=6 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:15.227083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:15.227561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:15.227984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:15.228664 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:15.229107 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:15.229610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:15.366519 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:15.376661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:15.378845 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:15.380091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a7c8c949-a5f8-440e-ab91-26eaa8ba4910 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.166319 Aug 31 04:08:15.380698 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 132/268] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:15 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:15.616527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:15.617234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:15.624721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:15.625209 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:15.625645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:15.626590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:15.627065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:15.627490 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:15.767407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:15.775654 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7c2c56d0-82d2-4cde-8a2c-9d6d30cff279 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.163538 Aug 31 04:08:15.776311 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 137/269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:15 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:15.954756 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:15.955518 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:15.962320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:15.962880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:15.963446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:15.964196 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:15.964675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:15.965115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:16.121308 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:16.129553 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-44b44570-3c2b-4093-b380-57794c336b84 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.179429 Aug 31 04:08:16.130122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 133/270] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:15 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:16.406475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:16.407160 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:16.413921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:16.414455 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:16.414914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:16.415687 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:16.416168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:16.416596 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:16.553704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:16.562348 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:16.563832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:16.565008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1cb5bd97-de2b-4bff-8b07-cbdd17aced76 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.165084 Aug 31 04:08:16.565576 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 138/271] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:16 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:16.799592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:16.800226 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:16.807306 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:16.807849 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:16.808330 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:16.809104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:16.809667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:16.810148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:16.952359 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:16.960861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-462c87df-5900-4f5e-b269-621699067a23 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.165739 Aug 31 04:08:16.961642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 134/272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:16 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:17.056457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-0d6e8623-69a8-4623-ad7a-0e8127521175 req-3d2143f9-673d-47df-8760-6eff3899214b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f84ef0-d99a-45a9-8374-94bdab970c84", "name": "network-vif-plugged", "status": "completed", "tag": "c1ca18a0-1ccb-4a55-ae54-f591b51f8fa3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:17.067441 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0d6e8623-69a8-4623-ad7a-0e8127521175 req-3d2143f9-673d-47df-8760-6eff3899214b service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:17.067925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0d6e8623-69a8-4623-ad7a-0e8127521175 req-3d2143f9-673d-47df-8760-6eff3899214b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:17.068352 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0d6e8623-69a8-4623-ad7a-0e8127521175 req-3d2143f9-673d-47df-8760-6eff3899214b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:17.079911 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-0d6e8623-69a8-4623-ad7a-0e8127521175 req-3d2143f9-673d-47df-8760-6eff3899214b service nova] Creating event network-vif-plugged:c1ca18a0-1ccb-4a55-ae54-f591b51f8fa3 for instance f3f84ef0-d99a-45a9-8374-94bdab970c84 on hv-cinder-85391 Aug 31 04:08:17.085049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-0d6e8623-69a8-4623-ad7a-0e8127521175 req-3d2143f9-673d-47df-8760-6eff3899214b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Aug 31 04:08:17.085639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 139/273] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:08:17.151994 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:17.152599 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:17.159654 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:17.160147 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:17.160762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:17.161458 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:17.161921 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:17.162338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:17.303647 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:17.311614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-77583961-4cd7-4a85-b625-a563427e3b13 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.163542 Aug 31 04:08:17.312176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 135/274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:17 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:17.592619 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:17.593486 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:17.602615 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:17.603343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:17.603953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:17.604905 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:17.605537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:17.606125 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:17.754625 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:17.766799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:17.768969 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:17.770646 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad4381a4-6858-4168-acce-fd7d7d303d2a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.184588 Aug 31 04:08:17.771528 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 140/275] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:17 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:17.985183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:17.986307 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:17.996915 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:17.997838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:17.998557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:17.999471 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:17.999831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:18.000504 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:18.141063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:18.149064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8a6c7b2e-ce1f-4108-8ef9-ca8acde1bfe8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.169820 Aug 31 04:08:18.149619 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 136/276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:17 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:18.333182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:18.333744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:18.340825 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:18.341331 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:18.341763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:18.342540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:18.342995 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:18.343452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:18.486308 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:18.494944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cdaa761b-61b1-4739-a310-8ef31d3c1825 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.165750 Aug 31 04:08:18.495647 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 141/277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:18 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:18.797396 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:18.798020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:18.804926 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:18.805432 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:18.805963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:18.806718 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:18.807366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:18.807807 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:19.169992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:19.170813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:19.172621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:19.177052 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:19.177641 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:19.178148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:19.178854 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:19.179336 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:19.179754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:19.180682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:19.182125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:19.183319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5079081f-31af-44ad-b000-120155627e86 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.391237 Aug 31 04:08:19.183874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 137/278] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:18 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:19.315534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:19.323251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4dcc9a93-4427-4cd9-bbaa-11897470e200 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1314 microversion: 2.1 time: 0.157246 Aug 31 04:08:19.323825 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 142/279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:19 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:19.517143 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:19.518008 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:19.524268 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:19.524746 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:19.525187 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:19.525933 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:19.526561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:19.526984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:19.674274 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:19.682863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7b175d52-b62a-4fc5-a423-afdf027248fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1522 microversion: 2.1 time: 0.170824 Aug 31 04:08:19.683489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 138/280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:19 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:20.207061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:20.208341 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:20.214916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.215450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.215879 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.216570 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.217131 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.217567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.220489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08a6d15e-ac18-4273-82d3-0015de9371d9", "device": "/dev/sdb"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:20.223495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:20.230179 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.230677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.231175 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.231891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.232338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.232810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.360754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:20.370880 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:20.372643 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:20.374178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2e0ae7a8-edc7-482a-8451-db7e59142752 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.170893 Aug 31 04:08:20.374798 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 143/281] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:20 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:20.379864 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:20.380702 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:20.387690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.388341 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.388849 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.389547 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.389998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.390416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.531084 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:20.539944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-778cc5d9-cefb-47ec-903d-e0b4e449ee26 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1464 microversion: 2.1 time: 0.163422 Aug 31 04:08:20.540773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 144/282] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:20 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:20.589202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:20.589692 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:20.596105 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.596602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.597230 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.598482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.599218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.599818 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.630121 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:08:20.738424 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2bb9777c-26a9-41af-be81-4ccd2428ccbc tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 204 len: 0 microversion: 2.1 time: 0.152455 Aug 31 04:08:20.739057 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 145/283] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:08:20 2022] DELETE /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:08:20.744067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:20.744755 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:20.750988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.751537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.752005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.752712 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.753166 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.753592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.904859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:20.918473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5ef0cfb6-c6d8-4363-a5e2-b5f78ebdd983 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1502 microversion: 2.1 time: 0.178228 Aug 31 04:08:20.919450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 146/284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:20 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:20.940008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:20.941121 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:20.950419 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.950908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.951545 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:20.952430 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:20.952884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:20.953301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:21.104336 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:21.114335 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bf6a3ea6-1bea-4aae-a7c5-d22ea7eeb094 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1470 microversion: 2.1 time: 0.179297 Aug 31 04:08:21.115107 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 147/285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:20 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:21.133638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:21.134397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:21.142571 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:21.143251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:21.143718 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:21.144478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:21.144840 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:21.145235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:21.295724 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:21.303656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-851172c1-fb64-4a60-a388-ec76b27f713e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1517 microversion: 2.1 time: 0.187576 Aug 31 04:08:21.304224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 148/286] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:21 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:21.398308 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:21.399020 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:21.404901 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:21.405380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:21.405837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:21.406514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:21.406984 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:21.407398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:21.544037 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:21.552873 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:21.554827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:21.556498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8fec5de7-1792-45d7-bbd9-1500ae1c03c7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.162277 Aug 31 04:08:21.557563 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 149/287] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:21 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:08:22.136168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:22.136966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:22.145225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:22.145881 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:22.146514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:22.147579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:22.148196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:22.148717 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:22.296412 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:22.307408 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ce05e5c6-70c5-4dbb-af39-777e3755cd74 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1470 microversion: 2.1 time: 0.175000 Aug 31 04:08:22.308326 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 150/288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:22 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:22.440089 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a368cfae-d66e-4860-a089-b7fbf9190ae7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "POST /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.223974 Aug 31 04:08:22.440700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 139/289] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:08:20 2022] POST /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9/os-volume_attachments => generated 194 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:08:22.581192 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:22.581803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:22.588176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:22.588661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:22.589117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:22.589797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:22.590235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:22.590656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:22.686384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:22.688769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:22.697234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:22.697725 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:22.698156 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:22.698853 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:22.699341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:22.699906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:22.726808 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lazy-loading 'flavor' on Instance uuid 05badbbb-888b-4ba8-8e63-c45489dabb5e {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:08:22.795229 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:22.799391 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:22.804912 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:22.806387 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:22.807836 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f4bda857-a928-42f4-8988-21cdc2d6b227 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.230591 Aug 31 04:08:22.808395 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 151/290] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:22 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:22.813296 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c49d3b08-c3c9-4125-b722-f97bac4a7374 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e/action" status: 200 len: 32 microversion: 2.1 time: 0.131715 Aug 31 04:08:22.813912 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 140/291] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:08:22 2022] POST /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e/action => generated 32 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:08:22.823743 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:22.824345 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:22.831338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:22.831840 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:22.832262 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:22.832940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:22.833382 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:22.833793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:22.977822 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:22.988396 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-71b39bfd-59df-49cc-b103-b505e8603181 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.168200 Aug 31 04:08:22.988907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 152/292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:22 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:23.330537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:23.331498 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:23.340650 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:23.341433 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:23.341976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:23.342801 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:23.343365 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:23.343791 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:23.480708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:23.489257 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8ef22a5d-a5d5-4b67-96ca-c3ad996f2a3e tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1470 microversion: 2.1 time: 0.163476 Aug 31 04:08:23.489868 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 141/293] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:23 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:23.833597 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:23.834360 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:23.841575 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:23.842153 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:23.842685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:23.843544 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:23.843997 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:23.844416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:23.990176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:23.998878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:24.000345 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:24.001513 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b27b84d5-fa23-4e42-adde-4413d85135b6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.172210 Aug 31 04:08:24.002037 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 153/294] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:23 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:24.010065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:24.010679 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:24.017854 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:24.018339 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:24.018749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:24.019467 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:24.019919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:24.020340 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:24.164697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:24.168267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:24.173509 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3e69f4f0-cc79-4e0e-b4f7-71575260a3a8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.167361 Aug 31 04:08:24.174087 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 142/295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:24 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:24.515080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:24.516004 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:24.525170 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:24.526605 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:24.527325 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:24.528444 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:24.529639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:24.530214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:24.752385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:24.762677 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-003bd7e7-68e2-4ff4-a417-4dfab4883cd8 tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1470 microversion: 2.1 time: 0.254244 Aug 31 04:08:24.763479 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 154/296] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:24 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:25.026333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:25.026946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:25.029394 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:25.043810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:25.044288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:25.045122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:25.045935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:25.046401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:25.046885 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:25.073260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a218a5be-193c-4b44-a6f1-85a80c1e5c2d req-4d3af551-ae12-4805-9bf4-0525eca6e49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f84ef0-d99a-45a9-8374-94bdab970c84", "name": "network-vif-deleted", "tag": "c1ca18a0-1ccb-4a55-ae54-f591b51f8fa3"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:25.084589 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a218a5be-193c-4b44-a6f1-85a80c1e5c2d req-4d3af551-ae12-4805-9bf4-0525eca6e49f service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:25.085284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a218a5be-193c-4b44-a6f1-85a80c1e5c2d req-4d3af551-ae12-4805-9bf4-0525eca6e49f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:25.085711 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a218a5be-193c-4b44-a6f1-85a80c1e5c2d req-4d3af551-ae12-4805-9bf4-0525eca6e49f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:25.102337 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a218a5be-193c-4b44-a6f1-85a80c1e5c2d req-4d3af551-ae12-4805-9bf4-0525eca6e49f service nova] Creating event network-vif-deleted:c1ca18a0-1ccb-4a55-ae54-f591b51f8fa3 for instance f3f84ef0-d99a-45a9-8374-94bdab970c84 on hv-cinder-85391 Aug 31 04:08:25.110141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a218a5be-193c-4b44-a6f1-85a80c1e5c2d req-4d3af551-ae12-4805-9bf4-0525eca6e49f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042566 Aug 31 04:08:25.111083 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 155/297] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:08:25.194902 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:25.195708 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:25.202170 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:25.202737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:25.203267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:25.203792 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:25.204096 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:25.204630 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:25.205108 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:25.212241 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:25.213604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:25.214863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c80cc11a-73ac-4f9b-b1fb-461b7b998083 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.193438 Aug 31 04:08:25.215469 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 143/298] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:25 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:25.348724 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:25.356877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a7f30aa1-109a-406b-9b98-78ec2431b9c5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.166624 Aug 31 04:08:25.357508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 156/299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:25 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:25.792458 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:25.793011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:25.800154 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:25.800639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:25.801411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:25.802111 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:25.802575 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:25.802996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:25.835248 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:25.835775 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:25.836207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:25.836645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lazy-loading 'fault' on Instance uuid f3f84ef0-d99a-45a9-8374-94bdab970c84 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:08:25.901452 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa26512830547db839cea342721da4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dceffdfa7224a4a84be50c94c6f3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:25.910894 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b54a0767-6d45-42cf-b78f-11a189673f6c tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 200 len: 1304 microversion: 2.1 time: 0.122795 Aug 31 04:08:25.922445 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 144/300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:25 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:26.238973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:26.239737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:26.242159 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:26.247610 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:26.248349 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:26.249081 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:26.250095 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:26.250719 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:26.251172 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:26.378378 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:26.378986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:26.385766 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:26.386343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:26.386833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:26.387608 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:26.388051 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:26.388870 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:26.403286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:26.412393 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:26.414252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:26.415471 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9caf7862-ff0f-45a3-9055-b9c25a675c92 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.180890 Aug 31 04:08:26.416083 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 157/301] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:26 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:26.537982 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:26.546231 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7dfe00a0-532a-491d-ae02-21aa3102d845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.172120 Aug 31 04:08:26.546948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 145/302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:26 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:26.933330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:26.934107 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] [instance: f3f84ef0-d99a-45a9-8374-94bdab970c84] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:26.945495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:26.946046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:26.946861 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:26.947916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:26.948529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:26.949085 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:26.968316 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] HTTP exception thrown: Instance f3f84ef0-d99a-45a9-8374-94bdab970c84 could not be found. Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Request method failure captured: Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 HTTP/1.1 Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt6gX3u8aRUFD-NV0IGTUI59XuBSUtBUlgYcykjBBGw1yoRp2aE7tH6r_VS-ruVlLgs4bDQCNUQ85JJW6rbtgN9n4ewuMh3WQr8rZULPZrQarJCpgA7G3P5JutMDzz7j0rvQKeA9gDy_WICnBblCbWmq5HdJ4bVP-jAT6yQtS9wrYYA Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 4dceffdfa7224a4a84be50c94c6f3d4b Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-160121581 Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:08:26.969952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4dceffdfa7224a4a84be50c94c6f3d4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4dceffdfa7224a4a84be50c94c6f3d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4dceffdfa7224a4a84be50c94c6f3d4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4dceffdfa7224a4a84be50c94c6f3d4b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-160121581 Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 4dceffdfa7224a4a84be50c94c6f3d4b Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-160121581 Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-160121581-project Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 3fa26512830547db839cea342721da4b Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-160121581-project Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance f3f84ef0-d99a-45a9-8374-94bdab970c84 could not be found. Aug 31 04:08:26.972194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'f3f84ef0-d99a-45a9-8374-94bdab970c84'} Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f84ef0-d99a-45a9-8374-94bdab970c84 could not be found. Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:08:26.973362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f84ef0-d99a-45a9-8374-94bdab970c84 could not be found. Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f84ef0-d99a-45a9-8374-94bdab970c84 could not be found. Aug 31 04:08:26.974946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:26.976274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] Returning 404 to user: Instance f3f84ef0-d99a-45a9-8374-94bdab970c84 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:08:26.976274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-daf27bcb-83dc-4030-812f-60f74abc8e3d tempest-VolumesNegativeTest-160121581 tempest-VolumesNegativeTest-160121581-project] 10.222.0.18 "GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84" status: 404 len: 111 microversion: 2.1 time: 0.042664 Aug 31 04:08:26.976274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 158/303] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:26 2022] GET /compute/v2.1/servers/f3f84ef0-d99a-45a9-8374-94bdab970c84 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:08:27.438481 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:27.439200 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:27.446104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:27.446575 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:27.447057 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:27.447840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:27.448272 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:27.448776 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:27.569067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:27.569736 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:27.576787 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:27.577438 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:27.577936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:27.578542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:27.578992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:27.579475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:27.605145 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:27.615360 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:27.617122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:27.618609 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3ab74e75-00a9-4723-b52a-13fb7daad842 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.184286 Aug 31 04:08:27.620015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 146/304] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:27 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:27.728698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:27.737437 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bf6cb32b-c42e-4d27-96a1-9caf618a0869 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.172093 Aug 31 04:08:27.738313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 159/305] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:27 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:28.644963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:28.645556 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:28.653733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:28.654016 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:28.654621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:28.655339 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:28.655931 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:28.656490 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:28.757801 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:28.758243 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:28.765100 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:28.765835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:28.766626 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:28.767657 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:28.768266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:28.768926 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:28.871618 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:28.883832 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:28.885597 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:28.886876 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a4f7f407-9a96-48e7-b476-11fd5e1d33dd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.246540 Aug 31 04:08:28.887624 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 147/306] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:28 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:28.965119 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:28.974016 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ee561092-c382-402b-919c-ee135f5b107f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.220114 Aug 31 04:08:28.974898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 160/307] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:28 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:29.913773 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:29.917287 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:29.925204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:29.926037 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:29.926491 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:29.927229 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:29.927824 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:29.928380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:29.996480 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:29.998176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:30.006679 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:30.007197 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:30.007620 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:30.008448 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:30.008896 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:30.009312 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:30.125838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:30.135946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:30.137733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:30.139299 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-61c6113d-b8ef-45ef-bdae-d7fb3d6ea4b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.229475 Aug 31 04:08:30.140049 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 148/308] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:29 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:30.173226 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:30.180957 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-946701ad-8495-441a-a2a5-e0c03489ae7b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.188479 Aug 31 04:08:30.181531 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 161/309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:29 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:31.161587 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:31.162402 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:31.170373 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:31.170858 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:31.171299 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:31.172191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:31.172636 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:31.173050 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:31.207689 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:31.208992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:31.218597 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:31.219450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:31.223446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:31.225420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:31.228694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:31.228694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:31.425729 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:31.438603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:31.440562 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:31.442479 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f4677175-5f98-4a32-9c96-276e2a923dcc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1743 microversion: 2.20 time: 0.284420 Aug 31 04:08:31.443794 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 149/310] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:31 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1743 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:31.470273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:31.479561 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a309e809-56d0-4f2a-bf7f-1a6103602f03 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.280473 Aug 31 04:08:31.480365 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 162/311] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:31 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:32.466362 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:32.467055 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:32.474054 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:32.474516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:32.474943 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:32.475714 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:32.476157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:32.476631 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:32.502227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:32.503548 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:32.511437 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:32.512163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:32.512631 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:32.513430 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:32.514193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:32.514808 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:32.728068 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:32.736954 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:32.738777 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:32.740033 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-091c1d88-9ebe-4d3e-8c50-ca4bbd66fe93 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1743 microversion: 2.20 time: 0.277837 Aug 31 04:08:32.740572 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 150/312] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:32 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1743 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:32.788506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:32.797360 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-48420965-c54c-4d51-8d87-c026cabfb29a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.299344 Aug 31 04:08:32.797923 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 163/313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:32 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:33.763371 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:33.764781 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:33.771813 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:33.772350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:33.772782 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:33.773480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:33.773930 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:33.774377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:33.820008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:33.821249 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:33.829446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:33.830600 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:33.831356 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:33.832821 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:33.833917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:33.834676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:34.016132 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:34.024668 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:34.026376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:34.027930 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3b3a5ddf-219c-480f-817e-e813f1b489ef tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.268808 Aug 31 04:08:34.028847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 151/314] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:33 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:34.073726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:34.082984 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3bb487be-7f76-4ccd-833e-37bc6e5d1a0f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.266689 Aug 31 04:08:34.084223 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 164/315] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:33 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:35.052735 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:35.053344 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:35.059882 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:35.060416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:35.060844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:35.061525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:35.061980 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:35.062422 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:35.105571 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:35.106175 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:35.113509 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:35.114018 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:35.114475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:35.115199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:35.115664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:35.116086 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:35.258788 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:35.277951 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:35.279811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:35.288032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d375ffd9-5c08-4307-b462-5fb7cf3b31bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.239161 Aug 31 04:08:35.288233 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:35.289902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 152/316] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:35 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:08:35.312037 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2317bdcd-5f22-4fcf-965e-4e35c049fca9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.210233 Aug 31 04:08:35.312875 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 165/317] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:35 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:36.024877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-b940d8ba-5d8b-4565-a533-a6ea51564f43 req-e1a1d7ca-e33b-4bcd-9284-732dbd3f0cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675abe1e-ac1e-458b-b5ac-745a7f6917b7", "name": "network-vif-plugged", "status": "completed", "tag": "4a38be32-98cb-48fd-b704-e08ed42a7fef"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:36.036604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b940d8ba-5d8b-4565-a533-a6ea51564f43 req-e1a1d7ca-e33b-4bcd-9284-732dbd3f0cf9 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:36.037461 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b940d8ba-5d8b-4565-a533-a6ea51564f43 req-e1a1d7ca-e33b-4bcd-9284-732dbd3f0cf9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:36.038094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b940d8ba-5d8b-4565-a533-a6ea51564f43 req-e1a1d7ca-e33b-4bcd-9284-732dbd3f0cf9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:36.052231 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-b940d8ba-5d8b-4565-a533-a6ea51564f43 req-e1a1d7ca-e33b-4bcd-9284-732dbd3f0cf9 service nova] Creating event network-vif-plugged:4a38be32-98cb-48fd-b704-e08ed42a7fef for instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 on hv-cinder-85391 Aug 31 04:08:36.058038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-b940d8ba-5d8b-4565-a533-a6ea51564f43 req-e1a1d7ca-e33b-4bcd-9284-732dbd3f0cf9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041254 Aug 31 04:08:36.059803 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 153/318] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:08:36.318267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:36.320262 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:36.328178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:36.334270 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:36.335360 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:36.352985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:36.353502 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:36.365083 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:36.367253 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:36.368145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:36.368810 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:36.373216 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:36.374368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:36.375417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:36.380324 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:36.380870 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:36.719059 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:36.727801 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:36.733166 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:36.735722 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d07f8b38-f75f-4b67-8cc6-798e779827e5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.424796 Aug 31 04:08:36.736566 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 166/319] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:36 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:36.741606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:36.753929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-17f97766-7148-4633-b7c4-291877cf7f9c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.423782 Aug 31 04:08:36.754543 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 154/320] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:36 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:37.761436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:37.762147 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:37.769495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:37.778890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:37.778890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:37.783664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:37.784514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:37.785100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:37.785618 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:37.786155 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:37.786288 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:37.786683 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:37.786798 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:37.788938 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:37.796318 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:37.796318 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:38.040513 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:38.050017 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:38.051908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:38.053338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-66e711e6-32eb-449c-8c90-f48d511d3edb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.296201 Aug 31 04:08:38.064374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:38.065191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 167/321] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:37 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:38.070450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6ae6a9e4-be75-47e6-a9a4-6115dc06025e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.298343 Aug 31 04:08:38.071083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 155/322] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:37 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:08:38.684893 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:38.685706 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:38.692089 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:38.692680 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:38.693201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:38.694135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:38.694791 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:38.695460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:38.722967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2432ca61-f235-4a0e-a95b-92e07c57e056 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/ips" status: 200 len: 149 microversion: 2.1 time: 0.041872 Aug 31 04:08:38.724032 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 168/323] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:08:38 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:08:39.078882 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:39.080193 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:39.094877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:39.096205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:39.109012 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:39.110186 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:39.110900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:39.123683 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:39.123683 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:39.124580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:39.124580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:39.124580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:39.124580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:39.125564 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:39.125564 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:39.125564 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:39.349336 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:39.359015 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-11f65e77-7a15-4ed9-b30e-4531f7d90284 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.269013 Aug 31 04:08:39.367437 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 169/324] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:39 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:39.436130 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:39.455992 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:39.457431 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:39.458834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bd452f17-d421-484a-8178-019533e69a91 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.385965 Aug 31 04:08:39.474891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 156/325] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:39 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:40.390091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:40.390909 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:40.397783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:40.398535 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:40.398962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:40.399883 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:40.400333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:40.400955 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:40.406159 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:40.482013 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:40.483201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:40.490920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:40.491763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:40.492452 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:40.493348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:40.494078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:40.494609 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:40.691457 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:40.694867 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:40.705253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-aa379590-916b-4525-a699-66179538e192 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.319422 Aug 31 04:08:40.705848 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 170/326] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:40 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:40.712740 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:40.714411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:40.715796 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f893091c-dec2-41be-8e73-0ed739f5100e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.237982 Aug 31 04:08:40.717085 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 157/327] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:40 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:08:41.725898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:41.726505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:41.734076 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:41.734856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:41.735347 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:41.736109 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:41.736721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:41.737301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:41.744122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:41.745423 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:41.752016 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:41.752504 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:41.752927 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:41.753809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:41.754256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:41.754670 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:41.984060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:41.992569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-420911b3-a237-40be-879e-5caec439880f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.270606 Aug 31 04:08:41.995012 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 171/328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:41 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:42.002244 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:42.015412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:42.017865 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:42.019118 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7a25b308-5d94-47a9-9df6-65d425e775bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.279107 Aug 31 04:08:42.031995 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 158/329] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:41 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:08:42.315607 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f21c0be-ccd3-4987-b1c3-2afc36a97662"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:42.317991 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:42.324922 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:42.325536 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:42.326193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:42.327061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:42.327932 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:42.328495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:43.018188 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:43.018767 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:43.025083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:43.025777 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:43.026407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:43.027122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:43.027733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:43.028349 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:43.180605 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:43.184506 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:43.190169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-df9c9688-2b57-46f6-9ca5-f63c84f84d6e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.176007 Aug 31 04:08:43.191179 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 159/330] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:43 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:43.196098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:43.196688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:43.205306 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:43.206042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:43.206773 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:43.207450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:43.208052 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:43.208621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:43.370948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:43.383910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:43.385397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:43.386621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-84ebf5cd-a19d-407d-9bad-545d7a22ecf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.194254 Aug 31 04:08:43.387557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 160/331] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:43 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:44.215408 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:44.216471 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:44.223774 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:44.224288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:44.224741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:44.225457 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:44.225934 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:44.226355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:44.373925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:44.383412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-14dabb72-99d2-48f7-b3e8-7cf330d656d2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.174626 Aug 31 04:08:44.383997 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 161/332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:44 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:44.409965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:44.410566 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:44.416708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:44.417194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:44.417601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:44.418308 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:44.418759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:44.419593 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:44.552908 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:44.566128 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:44.568576 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:44.570439 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4af999d9-ff6b-4747-bd79-829681289601 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.163849 Aug 31 04:08:44.571361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 162/333] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:44 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:45.406605 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:45.407492 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:45.414211 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:45.414687 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:45.415140 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:45.415822 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:45.416264 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:45.416683 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:45.564161 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:45.572272 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ceb15b31-b73d-4801-ab22-8b3261b6b03b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.170468 Aug 31 04:08:45.572838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 163/334] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:45 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:45.594131 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:45.594727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:45.600852 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:45.601547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:45.601974 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:45.602667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:45.603143 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:45.603552 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:45.740766 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:45.751838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:45.753628 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:45.754912 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1b1537fb-08dc-4dac-970f-78388e772974 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1738 microversion: 2.20 time: 0.164414 Aug 31 04:08:45.756540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 164/335] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:45 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:45.963602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e1622097-541c-457d-9239-7d620bb848aa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.651654 Aug 31 04:08:45.964186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 172/336] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:08:42 2022] POST /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments => generated 194 bytes in 3653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:08:46.593212 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:46.593947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:46.600704 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:46.600923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:46.601271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:46.602042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:46.602655 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:46.602813 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:46.774593 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:46.780598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:46.781292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:46.783124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f13fc824-b69d-4e2b-98e8-fe08ea703b0e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.193875 Aug 31 04:08:46.783708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 165/337] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:46 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:46.788075 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:46.788808 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:46.788993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:46.789683 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:46.790133 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:46.790555 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:47.217065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:47.225728 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:47.227177 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:47.228335 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1b9d084b-f15e-4c97-aa93-c53683ae6990 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.452549 Aug 31 04:08:47.228890 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 173/338] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:46 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:47.804974 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:47.805623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:47.812839 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:47.813349 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:47.813774 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:47.814455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:47.814901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:47.815336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:48.017057 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:48.025759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-db84da38-8d7b-44bb-a9b2-af87c6ecfdaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.224841 Aug 31 04:08:48.026311 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 166/339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:47 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:48.256040 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:48.257026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:48.266077 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:48.266568 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:48.267001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:48.267711 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:48.268166 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:48.268590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:48.405136 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:48.413783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:48.415258 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:48.416417 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7a71b69b-c9a1-4748-b39c-aec1f0840670 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.166902 Aug 31 04:08:48.416978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 174/340] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:48 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:49.056497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:49.057323 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:49.067848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.068556 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.069150 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.070230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.070916 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.071596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.208440 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:49.216471 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7dd7d19a-488a-4987-9ca4-1ab37a3a118b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1503 microversion: 2.1 time: 0.166139 Aug 31 04:08:49.217025 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 167/341] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:49 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:49.236507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ff3b285-d140-43f2-abd7-b088bd80e81c"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:49.239412 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:49.250541 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.251009 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.251502 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.252176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.252639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.253049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.276060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] HTTP exception thrown: Cannot 'attach_volume' instance 05badbbb-888b-4ba8-8e63-c45489dabb5e while it is in vm_state rescued Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Request method failure captured: Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e/os-volume_attachments HTTP/1.1 Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 74 Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LN2xm1e7l3XFMnWbmEAaROgQ1gXyS3SqClPo4af2j-ozeboSvhGYasV6hYLHuQvowyA6i4IHjFdIknTIaMgM0CMmswvcO0WF5hoAo9nRPMTue_8211fo0yFb6dVUNAQm55ga87eUbSE5aajuJrQBereu438VnS_rxuCv2jqmIXTQ Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:08:49.277730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_490f695240294bbaa99f5eaa1e32b977", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 77fb76da34bf44a1b214a08bb4b8e51b Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {"volumeAttachment": {"volumeId": "6ff3b285-d140-43f2-abd7-b088bd80e81c"}} Aug 31 04:08:49.279590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Cannot 'attach_volume' instance 05badbbb-888b-4ba8-8e63-c45489dabb5e while it is in vm_state rescued Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'server_id': '05badbbb-888b-4ba8-8e63-c45489dabb5e', 'body': {'volumeAttachment': {'volumeId': '6ff3b285-d140-43f2-abd7-b088bd80e81c'}}} Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05badbbb-888b-4ba8-8e63-c45489dabb5e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:08:49.280411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 05badbbb-888b-4ba8-8e63-c45489dabb5e while it is in vm_state rescued Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:08:49.281837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:08:49.283191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:08:49.283191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:08:49.283191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 05badbbb-888b-4ba8-8e63-c45489dabb5e while it is in vm_state rescued Aug 31 04:08:49.283191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:08:49.283191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Returning 409 to user: Cannot 'attach_volume' instance 05badbbb-888b-4ba8-8e63-c45489dabb5e while it is in vm_state rescued {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:08:49.283191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1cdb4aa3-c0e0-431d-9eda-77bb6b23f7fe tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046623 Aug 31 04:08:49.283191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 175/342] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:08:49 2022] POST /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 04:08:49.289277 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:49.290102 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:49.300557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.301302 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.301993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.303089 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.303860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.304549 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.374976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-2baa2f6b-94dd-42f6-9bdb-61cbe4d50c49 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e/action" status: 202 len: 0 microversion: 2.1 time: 0.090010 Aug 31 04:08:49.375639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 168/343] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:08:49 2022] POST /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:08:49.383929 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:49.384546 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:49.390768 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.391286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.391722 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.392407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.392857 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.393279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.439829 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:49.440582 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:49.446897 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.447418 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.447901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.448656 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:49.449123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:49.449541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:49.561697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:49.570005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-11068020-241d-432e-9fb1-6d8785493258 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.189958 Aug 31 04:08:49.570579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 176/344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:49 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:49.605313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:49.614466 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:49.615914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:49.617076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-31924307-aa7d-42db-980e-e3ed351dd1bf tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.181692 Aug 31 04:08:49.617661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 169/345] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:49 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:50.593301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:50.593949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:50.602028 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:50.602590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:50.603105 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:50.603934 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:50.604457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:50.604949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:50.639679 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:50.640315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:50.646929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:50.647469 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:50.647896 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:50.648595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:50.649042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:50.649466 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:50.794690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:50.803541 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cf94c3a3-6472-460a-9be6-99958e191904 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.215201 Aug 31 04:08:50.804221 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 177/346] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:50 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:50.813374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-66b9684d-03d4-4d43-8fe2-2836a79b7052 req-8d0f4449-8727-4c9e-95eb-c9750a2f83e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675abe1e-ac1e-458b-b5ac-745a7f6917b7", "name": "network-vif-unplugged", "status": "completed", "tag": "4a38be32-98cb-48fd-b704-e08ed42a7fef"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:08:50.824379 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-66b9684d-03d4-4d43-8fe2-2836a79b7052 req-8d0f4449-8727-4c9e-95eb-c9750a2f83e9 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:50.824946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-66b9684d-03d4-4d43-8fe2-2836a79b7052 req-8d0f4449-8727-4c9e-95eb-c9750a2f83e9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:50.825606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-66b9684d-03d4-4d43-8fe2-2836a79b7052 req-8d0f4449-8727-4c9e-95eb-c9750a2f83e9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:50.833940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:50.842696 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:50.844522 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:50.845334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-66b9684d-03d4-4d43-8fe2-2836a79b7052 req-8d0f4449-8727-4c9e-95eb-c9750a2f83e9 service nova] Creating event network-vif-unplugged:4a38be32-98cb-48fd-b704-e08ed42a7fef for instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 on hv-cinder-85391 Aug 31 04:08:50.846116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e46d2e9d-d499-4759-a9cc-3e844c026ae7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.210367 Aug 31 04:08:50.847223 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 170/347] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:50 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:50.850590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-66b9684d-03d4-4d43-8fe2-2836a79b7052 req-8d0f4449-8727-4c9e-95eb-c9750a2f83e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041489 Aug 31 04:08:50.851353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 178/348] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:08:51.741427 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:51.741917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:51.748631 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:51.749115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:51.749547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:51.750235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:51.750682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:51.751132 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:51.827388 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:51.828072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:51.834228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:51.834936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:51.835393 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:51.836049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:51.836519 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:51.837028 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:51.890788 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lazy-loading 'services' on Instance uuid f02ea746-4312-45b9-9df2-9e9ef4279ca9 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:08:51.975756 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:51.983926 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-43bf5980-b0d7-4eac-a2be-b4b373705b11 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.161535 Aug 31 04:08:51.984512 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 179/349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:51 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:51.989749 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:51.990346 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:51.996658 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:51.997298 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:51.998285 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:51.999250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:51.999950 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:52.000394 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:52.013995 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e0053ec9-03d1-407d-b02f-879a3cacc590 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9/os-volume_attachments/08a6d15e-ac18-4273-82d3-0015de9371d9" status: 202 len: 0 microversion: 2.1 time: 0.276669 Aug 31 04:08:52.014580 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 171/350] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:08:51 2022] DELETE /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9/os-volume_attachments/08a6d15e-ac18-4273-82d3-0015de9371d9 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:08:52.134865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:52.143811 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:52.145225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:52.146380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9a16b352-82b3-476b-a6dc-54e9761cfa8e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.160748 Aug 31 04:08:52.146903 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 180/351] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:51 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:53.007429 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:53.008134 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:53.014647 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:53.015165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:53.015646 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:53.016532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:53.016700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:53.017147 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:53.156801 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:53.164899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-914a7a8d-81c8-4fd5-a603-46058c033357 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.162095 Aug 31 04:08:53.165474 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 172/352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:53 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:53.170240 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:53.170845 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:53.178071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:53.178468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:53.178894 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:53.179776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:53.180221 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:53.180768 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:53.326555 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:53.334634 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:53.336099 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:53.337231 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-315e2550-000a-4721-b65f-908a1fb46e0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.171697 Aug 31 04:08:53.337835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 181/353] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:53 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:54.185815 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:54.187404 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:54.193915 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:54.194526 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:54.195204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:54.198704 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:54.199539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:54.200062 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:54.338454 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:54.346831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-56bdb8ff-50b2-42ba-a460-19cba4095ce3 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.165095 Aug 31 04:08:54.347439 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 173/354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:54 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:54.360469 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:54.361085 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:54.367891 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:54.368596 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:54.369024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:54.369777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:54.370148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:54.370580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:54.511193 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:54.519778 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:54.521224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:54.522398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5274ad22-3307-426d-9456-9f434f6bd848 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.166513 Aug 31 04:08:54.522958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 182/355] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:54 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:55.368583 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:55.369213 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:55.371829 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=64 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:55.377338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:55.377823 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:55.378252 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:55.378946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:55.379422 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:55.379840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:55.519315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:55.522895 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:55.528090 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-938f3e34-abb5-4873-a548-0cb8e0816011 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.163825 Aug 31 04:08:55.528780 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 174/356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:55 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:55.545827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:55.547117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:55.553726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:55.554199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:55.554623 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:55.555354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:55.555868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:55.556367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:55.694269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:55.703204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:55.704643 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:55.705820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-26ee85d0-d49c-42f6-8340-44e551c73ccd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.164031 Aug 31 04:08:55.706382 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 183/357] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:55 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:56.555980 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:56.556739 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:56.565358 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:56.565835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:56.566286 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:56.567151 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:56.567726 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:56.568355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:56.704941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:56.713877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c3f9ff61-bb45-4b40-a7cc-a60e8a9ac52d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.163762 Aug 31 04:08:56.714466 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 175/358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:56 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:56.734138 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:56.735374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:56.739396 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=54 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:56.744820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:56.745305 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:56.746085 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:56.746985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:56.747476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:56.747893 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:56.938857 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:56.947687 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:56.949252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:56.950547 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1dcc22cd-8164-4a31-bfa9-cd2780180279 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.220593 Aug 31 04:08:56.951417 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 184/359] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:56 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:57.737068 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:57.737897 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:57.747850 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:57.748488 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:57.749049 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:57.749844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:57.750327 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:57.750929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:57.891089 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:57.898561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-2d21b7e3-5c61-4b0a-bc3c-7e1b88da2877 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.165974 Aug 31 04:08:57.911484 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 176/360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:57 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:57.974135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:57.974848 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:57.982468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:57.983239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:57.983857 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:57.984723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:57.985328 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:57.985926 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:58.122044 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:58.130872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:58.132355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:58.133530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-47e3c40d-9807-4bea-b8da-c3b583b302bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.163449 Aug 31 04:08:58.134100 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 185/361] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:57 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:08:58.921021 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:58.921552 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:58.927964 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:58.928643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:58.929405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:58.930050 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:58.930941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:58.931156 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:59.156917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:08:59.158218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:08:59.166405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:59.166858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:59.167288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:59.167731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:59.168926 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:08:59.169658 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:08:59.170268 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:08:59.179411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-2cb6c250-567d-492c-82a6-bf76db2d6995 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.262869 Aug 31 04:08:59.190878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:59.194891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 177/362] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:08:58 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:08:59.395794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:59.404608 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:59.406028 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:08:59.407410 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3b7b90a3-16e1-4885-a201-bd55c019ec63 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.254337 Aug 31 04:08:59.407995 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 186/363] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:08:59 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:00.202019 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:00.202637 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:00.209667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:00.210210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:00.210574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:00.211678 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:00.212127 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:00.212545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:00.401877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:00.410771 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-98370ac0-f6aa-43f2-ab24-3ce9e1a36d28 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.213131 Aug 31 04:09:00.411835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 178/364] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:00 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:00.429832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:00.434506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:00.442692 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:00.443579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:00.444225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:00.445080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:00.445913 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:00.446385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:00.638102 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:00.647669 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:00.649217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:00.650603 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a26b51c4-697a-4697-92b5-3448573257d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.224554 Aug 31 04:09:00.651296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 187/365] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:00 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:01.432251 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:01.433482 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:01.442565 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:01.443219 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:01.443736 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:01.444703 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:01.447238 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:01.447772 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:01.674763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:01.675399 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:01.681672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:01.682151 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:01.682586 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:01.683307 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:01.683763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:01.684247 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:01.699212 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:01.711543 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c6a99cb2-8daa-4afc-965f-3376eb2eb257 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.284205 Aug 31 04:09:01.713099 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 179/366] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:01 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:01.922974 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:01.934317 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:01.937065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:01.938797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1403a8ff-804b-42b7-b7bf-9796ac8d49c4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1720 microversion: 2.20 time: 0.267780 Aug 31 04:09:01.939790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 188/367] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:01 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:09:02.742628 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:02.742628 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:02.758532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:02.759304 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:02.759923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:02.760811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:02.761416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:02.762042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:02.913676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:02.922675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e199b24a-3009-4d42-92ff-8a12936b304f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.193303 Aug 31 04:09:02.923309 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 180/368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:02 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:02.961899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:02.963161 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:02.981126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:02.981968 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:02.982438 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:02.983219 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:02.983664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:02.984066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:03.215915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:03.225637 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:03.230256 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:03.232082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e9a8d3e0-7a9a-40f7-9f38-abd7b5103bc8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1723 microversion: 2.20 time: 0.274089 Aug 31 04:09:03.248764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 189/369] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:02 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:03.257134 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8feb5f7-6edb-48a2-a8f6-3e361ba5987d"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:03.259842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:03.273053 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:03.273737 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:03.274366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:03.275116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:03.275538 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:03.275981 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:03.768350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-70a90c9a-3aa4-400c-9c7e-d2b414054155 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.515155 Aug 31 04:09:03.769039 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 181/370] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Aug 31 04:09:03 2022] POST /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments => generated 188 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:09:03.919152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:03.920284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:03.935098 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:03.936213 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:03.936213 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:03.936979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:03.937619 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:03.938254 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:03.951680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:03.952274 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:03.959577 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:03.960303 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:03.960902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:03.961885 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:03.963230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:03.963868 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:04.022771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120662) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 04:09:04.119141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d696695b-088d-407f-92cf-e652d0fb9839 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/action" status: 202 len: 0 microversion: 2.20 time: 0.205298 Aug 31 04:09:04.119931 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 190/371] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 31 04:09:03 2022] POST /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:09:04.128655 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:04.129500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:04.140667 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:04.141174 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:04.142005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:04.142942 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:04.143652 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:04.144421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:04.178680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:04.188336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-59df8323-8c8e-4570-b73e-72d03d970ced tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.244484 Aug 31 04:09:04.203337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 182/372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:03 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:04.385881 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-946af063-8a1a-4048-a09f-d6751b8904ef tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: .version_select at 0x7f88aeb8b4c0>, body: {"keypair": {"name": "tempest-keypair-1675423434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElyzbo8BPJej9ogCN3sJEoz+UOCSn6FCgrWqMlU2Y3RJN1MhGffLvs0WdJnwLwd+i2jA7Ul6XYVES585lwsLyOxyOiMVKuBcRp/Ie/68tkWCkFOHSXomka3YNkxxQTckg=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:04.404177 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-946af063-8a1a-4048-a09f-d6751b8904ef tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:09:04.410232 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-946af063-8a1a-4048-a09f-d6751b8904ef tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for user f80c8c1d6af7450eb8f936df231ad63b and project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:09:04.449064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-946af063-8a1a-4048-a09f-d6751b8904ef tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067411 Aug 31 04:09:04.456701 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 183/373] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:09:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:09:04.772859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:04.801697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:04.807209 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:04.815319 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bf365bce-f611-4df0-9b07-48254ab58db5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1809 microversion: 2.20 time: 0.686544 Aug 31 04:09:04.831051 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 191/374] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:04 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1809 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:09:05.012000 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:05.013515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:05.030978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:05.033147 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:05.035625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:05.040245 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:05.041780 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:05.043752 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:05.108796 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:09:05.219741 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:05.220255 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:05.241806 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:05.242645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:05.259513 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:05.260996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:05.262355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:05.264381 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:05.332511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ae3aa65b-a7d7-4a49-bf18-5aab91258016 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 204 len: 0 microversion: 2.1 time: 0.334714 Aug 31 04:09:05.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 184/375] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:09:04 2022] DELETE /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:09:05.348751 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:05.353794 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:05.380493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:05.382965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:05.388419 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:05.392596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:05.395759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:05.398137 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:05.841183 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:05.854339 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:05.865861 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dd828fc5-2bc8-4aa0-8213-31ec364d121a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.656789 Aug 31 04:09:05.867063 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 192/376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:05 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:05.869942 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b1c2511d-ede0-416a-8a45-b29ea972c400 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1514 microversion: 2.1 time: 0.530924 Aug 31 04:09:05.870494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 185/377] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:05 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1514 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:05.879807 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:05.880649 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:05.902243 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:05.902997 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:05.903634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:05.904521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:05.905060 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:05.905582 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:06.145269 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:06.156120 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:06.157625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:06.158844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-af508ac2-0ea0-4e0d-b29f-0233da7a44a1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1749 microversion: 2.20 time: 0.286782 Aug 31 04:09:06.159417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 186/378] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:05 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1749 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:06.893523 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:06.896201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:06.899880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:06.900571 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:06.909044 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:06.910338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:06.910996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:06.912218 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:06.912875 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:06.913499 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:06.918592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:06.919140 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:06.919586 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:06.922665 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:06.923199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:06.923707 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:07.604778 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:07.616138 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-711c41b8-9f93-45a9-9f90-d05332223032 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1511 microversion: 2.1 time: 0.730638 Aug 31 04:09:07.616732 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 193/379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:06 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1511 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:07.630835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:07.631713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:07.639557 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:07.640297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:07.640917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:07.641786 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:07.642566 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:07.643248 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:07.654467 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:07.681547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-64815d16-996f-4f00-a3bd-6085352cac78 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1514 microversion: 2.1 time: 0.782254 Aug 31 04:09:07.684221 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 187/380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:06 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1514 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:08.014661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:08.030201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:08.032276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:08.033923 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-44cdfa4c-e95e-4c40-a527-0faf823567d8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1749 microversion: 2.20 time: 0.413746 Aug 31 04:09:08.034863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 194/381] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:07 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1749 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:08.078346 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1039775", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df2a7da3-c61f-4600-a4d7-00eeb18098d5"}], "security_groups": [{"name": "tempest-securitygroup--1280523041"}], "key_name": "tempest-keypair-1675423434", "user_data": "}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:08.242299 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] validate_networks() for [('df2a7da3-c61f-4600-a4d7-00eeb18098d5', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:09:08.639584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:08.640252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:08.651342 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:08.652090 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:08.654094 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:08.655496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:08.656149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:08.657442 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:09.118802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:09.133207 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2da35fd1-fef5-4fdc-aa4f-adf68e21e40f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1517 microversion: 2.1 time: 0.498742 Aug 31 04:09:09.134276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 195/382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:08 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1517 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:09.142127 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:09.142742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:09.169666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:09:09.170189 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:09:09.170626 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:09:09.171052 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:09:09.171544 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:09:09.192899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:09.193690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:09.194002 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:09.201616 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:09.202718 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:09.203889 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:09.205596 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:09.211642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:09.212371 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:09.230571 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:09.232640 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:09.233939 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:09.288970 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:09.333658 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:09:09.352159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for user f80c8c1d6af7450eb8f936df231ad63b and project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:09:09.415753 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:09:09.421194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:09:09.446886 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:09.462361 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8f0f8687-0ae3-4705-8a71-b17bbbf31134 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1472 microversion: 2.1 time: 0.327112 Aug 31 04:09:09.463151 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 196/383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:09 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:09.472322 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:09.485644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:09.509419 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:09.510947 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:09.511626 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:09.514227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:09.515142 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:09.518201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:09.555842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-90c2aac2-dca7-4f90-8c42-d9162ceac40d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.481787 Aug 31 04:09:09.557192 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 188/384] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:09:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:09:09.572824 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-405fc1b8-e987-42d8-ad67-c4039294bccf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:09.585091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-405fc1b8-e987-42d8-ad67-c4039294bccf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:09.779838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-405fc1b8-e987-42d8-ad67-c4039294bccf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:09.791555 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-405fc1b8-e987-42d8-ad67-c4039294bccf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1239 microversion: 2.1 time: 0.225474 Aug 31 04:09:09.794919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 189/385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:09 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1239 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:09.815605 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-e186bdd6-6a89-4760-bd10-6398c488a86e req-272d5332-bb4d-4838-8210-4017074e098e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02ea746-4312-45b9-9df2-9e9ef4279ca9", "name": "network-vif-deleted", "tag": "6a5ae5f2-2c6e-46a2-a11e-9bfa01e50e69"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:09.844439 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-e186bdd6-6a89-4760-bd10-6398c488a86e req-272d5332-bb4d-4838-8210-4017074e098e service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:09.847774 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-e186bdd6-6a89-4760-bd10-6398c488a86e req-272d5332-bb4d-4838-8210-4017074e098e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:09.848335 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-e186bdd6-6a89-4760-bd10-6398c488a86e req-272d5332-bb4d-4838-8210-4017074e098e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:09.906285 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-e186bdd6-6a89-4760-bd10-6398c488a86e req-272d5332-bb4d-4838-8210-4017074e098e service nova] Creating event network-vif-deleted:6a5ae5f2-2c6e-46a2-a11e-9bfa01e50e69 for instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 on hv-cinder-85391 Aug 31 04:09:09.921333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-e186bdd6-6a89-4760-bd10-6398c488a86e req-272d5332-bb4d-4838-8210-4017074e098e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121609 Aug 31 04:09:09.927370 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 190/386] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:10.134809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:10.154855 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:10.156728 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:10.158199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-124ebe96-1661-4188-ad2f-b4096b467a35 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.693807 Aug 31 04:09:10.158763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 197/387] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:09 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:10.500540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:10.501379 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:10.511172 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:10.517754 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:10.518495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:10.519320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:10.519838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:10.520321 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:10.613270 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:10.615560 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:10.617086 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:10.618232 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lazy-loading 'fault' on Instance uuid f02ea746-4312-45b9-9df2-9e9ef4279ca9 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:09:10.684149 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:10.692502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8b30f019-53b7-4708-bb0b-deb3c5558bfa tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 200 len: 1308 microversion: 2.1 time: 0.205836 Aug 31 04:09:10.695462 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 191/388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:10 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:10.818758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:10.819867 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:10.828454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:10.829584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:10.830339 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:10.831606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:10.832391 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:10.833162 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:10.973849 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:10.985565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0fa4356c-9cfc-4b3c-a9b9-c69bb659770b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1291 microversion: 2.1 time: 0.170752 Aug 31 04:09:10.986704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 198/389] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:10 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1291 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:11.010460 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8d69c15b-2569-438b-8c20-666b9ee58136 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'create', calling method: .version_select at 0x7f88ad442670>, body: {"keypair": {"name": "tempest-keypair-81108730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmA4zmNAbghizMydm+YT/DSIZLvVZyVTC/AKrsiovmroQxCSjEBOAmE5KDEwi2m+yuhnckWQXJxytNEcwL2BOFnynKM8vKOmOIsBoEJ8eNn2/SBcWIASQUI9NEsZlidKw=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:11.037360 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-8d69c15b-2569-438b-8c20-666b9ee58136 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Getting quotas for project 490f695240294bbaa99f5eaa1e32b977. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:09:11.041592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-8d69c15b-2569-438b-8c20-666b9ee58136 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Getting quotas for user 77fb76da34bf44a1b214a08bb4b8e51b and project 490f695240294bbaa99f5eaa1e32b977. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:09:11.084656 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8d69c15b-2569-438b-8c20-666b9ee58136 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.080083 Aug 31 04:09:11.086008 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 192/390] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:09:11 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:11.181291 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:11.181893 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:11.195579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:11.196162 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:11.196662 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:11.197439 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:11.198005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:11.198569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:11.509930 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:11.528512 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:11.530268 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:11.531744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-70602873-4e31-4190-a99b-507b1d86527c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.354521 Aug 31 04:09:11.533252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 199/391] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:11 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:11.717515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:11.718277 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: f02ea746-4312-45b9-9df2-9e9ef4279ca9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:11.733553 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:11.742392 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:11.742921 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:11.743606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:11.744060 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:11.744484 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:11.781841 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] HTTP exception thrown: Instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 could not be found. Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Request method failure captured: Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 HTTP/1.1 Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt6LaUyAiRAQJz9RB3nMmHos4stUfDXx8fxx4a-yxrlrJf8t-_1C2ziqIAbEmoQcoLZwH3I0LvIGvnWKOqo2swtNWs5xIRlalh4Hh1oqSiLYQpT2JpNjiTCPuoybox5RKCGTTEijfmtDDge5fDlvVxWlzEQmGQFa8JqdoSNScZqcLsc Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: d362e24b36234e6b9a62f07a06dcd9f3 Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1513228801 Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:09:11.790817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d362e24b36234e6b9a62f07a06dcd9f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d362e24b36234e6b9a62f07a06dcd9f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d362e24b36234e6b9a62f07a06dcd9f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d362e24b36234e6b9a62f07a06dcd9f3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-VolumesSnapshotTestJSON-1513228801 Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: d362e24b36234e6b9a62f07a06dcd9f3 Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1513228801 Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-VolumesSnapshotTestJSON-1513228801-project Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: ffdeb3e2f0ec411682815e1d4197f662 Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-VolumesSnapshotTestJSON-1513228801-project Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 could not be found. Aug 31 04:09:11.792621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': 'f02ea746-4312-45b9-9df2-9e9ef4279ca9'} Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 could not be found. Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:09:11.793666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 could not be found. Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 could not be found. Aug 31 04:09:11.796173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:09:11.797529 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Returning 404 to user: Instance f02ea746-4312-45b9-9df2-9e9ef4279ca9 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:09:11.797529 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6ea733b5-a9c0-4040-8f8d-2349b591eeeb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9" status: 404 len: 111 microversion: 2.1 time: 0.079795 Aug 31 04:09:11.809484 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 193/392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:11 2022] GET /compute/v2.1/servers/f02ea746-4312-45b9-9df2-9e9ef4279ca9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:09:12.011153 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:12.011968 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:12.025671 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:12.036777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:12.037748 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:12.038686 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:12.043004 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:12.043871 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:12.303250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:12.315234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0bfb4608-dd63-44bb-81b5-9eade7069a85 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1297 microversion: 2.1 time: 0.307933 Aug 31 04:09:12.326498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 200/393] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:12 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1297 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:12.563041 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:12.563700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:12.580437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:12.583212 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:12.585146 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:12.586837 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:12.589032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:12.590163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:12.971367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:13.000424 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:13.003450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:13.005030 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-521354f6-611d-425c-a549-46d14ba5dea5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.450592 Aug 31 04:09:13.021433 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 194/394] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:12 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:13.353048 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:13.354581 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:13.384218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:13.385341 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:13.385894 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:13.386867 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:13.387357 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:13.387789 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:13.987900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:14.010753 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9225b058-588d-4d84-b4b4-0805ba7fe474 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.654317 Aug 31 04:09:14.013816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 201/395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:13 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:14.036495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:14.037818 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:14.059228 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:14.060460 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:14.062168 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:14.063379 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:14.067313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:14.069007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:14.463768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:14.478022 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1854623042", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b3892f5-0e7b-4fb7-bd9d-bcb974c2220e"}], "security_groups": [{"name": "tempest-securitygroup--296161658"}], "key_name": "tempest-keypair-81108730", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:14.486671 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:14.488458 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:14.489637 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7882e634-d61d-4a64-bf7c-7c5b4d0d3be1 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.457737 Aug 31 04:09:14.490187 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 195/396] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:14 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:15.040247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:15.040951 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:15.061375 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:15.063668 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:15.067686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:15.068863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:15.069767 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:15.070425 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:15.353523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:15.362518 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6c1eadd1-112e-4466-a53a-79e84e95816d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.328202 Aug 31 04:09:15.383868 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 196/397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:15 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:15.516076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:15.516607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:15.527712 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:15.528237 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:15.528657 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:15.529399 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:15.539463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:15.540184 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:16.276931 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:16.291271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:16.295223 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:16.299843 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1a2ba3c8-3d20-47ca-a653-d977a4dcd67c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.786860 Aug 31 04:09:16.302486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 197/398] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:15 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:16.388413 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:16.389327 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:16.400502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:16.404110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:16.405404 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:16.406986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:16.408715 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:16.410033 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:17.056825 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:17.066079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3279b008-21ce-4b83-b628-ecc3657d869a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.681757 Aug 31 04:09:17.079817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 198/399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:16 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:17.325653 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:17.326767 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:17.340601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:17.341991 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:17.342942 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:17.344333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:17.347587 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:17.348259 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:17.726955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:17.745125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:17.746600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:17.747828 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-89d259b7-fea2-4d8b-bb18-1cbc6d40a4be tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.426388 Aug 31 04:09:17.777894 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 199/400] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:17 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:17.797874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-f0854d5d-53e9-4dca-9aef-eded4cce434e req-65b35418-da41-42b0-9721-0f5aabe9e00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdae6298-1a2e-4f4a-88e0-32a21a1fed41", "tag": "4a5f6087-e036-48f1-876a-01f9c49bc717"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:17.809282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-f0854d5d-53e9-4dca-9aef-eded4cce434e req-65b35418-da41-42b0-9721-0f5aabe9e00f service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:17.818648 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-f0854d5d-53e9-4dca-9aef-eded4cce434e req-65b35418-da41-42b0-9721-0f5aabe9e00f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:17.823053 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-f0854d5d-53e9-4dca-9aef-eded4cce434e req-65b35418-da41-42b0-9721-0f5aabe9e00f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:17.844708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-f0854d5d-53e9-4dca-9aef-eded4cce434e req-65b35418-da41-42b0-9721-0f5aabe9e00f service nova] Creating event network-changed:4a5f6087-e036-48f1-876a-01f9c49bc717 for instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 on hv-cinder-85391 Aug 31 04:09:17.853235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-f0854d5d-53e9-4dca-9aef-eded4cce434e req-65b35418-da41-42b0-9721-0f5aabe9e00f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073509 Aug 31 04:09:17.858609 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 200/401] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:18.104690 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:18.105902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:18.113078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:18.116976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:18.118191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:18.118863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:18.119826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:18.120489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:18.121671 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:18.403060 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:18.417727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4818d7b1-37db-4a4b-8929-34d127f620c5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.320936 Aug 31 04:09:18.427157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 201/402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:18 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:18.770268 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:18.771189 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:18.777943 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:18.778502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:18.779136 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:18.780063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:18.780682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:18.781107 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:18.929773 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:18.940305 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:18.941861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:18.943055 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a638641b-9ac0-4647-a025-8053530f836a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.176805 Aug 31 04:09:18.944031 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 202/403] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:18 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:19.439810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:19.440526 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:19.451454 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:19.454388 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:19.455210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:19.455911 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:19.456969 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:19.457659 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:19.459071 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:19.686154 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:19.696262 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-fdc6a3f3-4234-4c0b-b961-e5a5830211a7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.260673 Aug 31 04:09:19.697731 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 203/404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:19 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:19.966191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:19.967095 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:19.973501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:19.974044 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:19.974539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:19.975341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:19.975848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:19.976328 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:20.195612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:20.206151 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:20.207675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:20.208977 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8ca06ec9-df83-4337-93da-0bba9b864189 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.247226 Aug 31 04:09:20.216034 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 204/405] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:19 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:09:20.704597 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-808808066", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "networks": [{"uuid": "f3daff5e-9e3d-4999-a212-86ec6d078ed2"}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:21.055526 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=16 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:22.936488 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] validate_networks() for [('f3daff5e-9e3d-4999-a212-86ec6d078ed2', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:09:23.051797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] validate_networks() for [('4b3892f5-0e7b-4fb7-bd9d-bcb974c2220e', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:09:23.555560 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:09:23.556111 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:09:23.556686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:09:23.557307 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:09:23.557812 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:09:23.574212 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:23.574814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:23.575410 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:23.577783 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:23.578382 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:23.578921 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:23.597102 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Getting quotas for project d362e24b36234e6b9a62f07a06dcd9f3. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:09:23.601486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Getting quotas for user ffdeb3e2f0ec411682815e1d4197f662 and project d362e24b36234e6b9a62f07a06dcd9f3. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:09:23.614431 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:09:23.617246 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:09:23.679185 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f6e6a03f-fdd0-4ef8-8ba1-b5754e1b7a94 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.979154 Aug 31 04:09:23.679830 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 205/406] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 04:09:23.686368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:23.687305 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:23.689943 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:09:23.691558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:09:23.692266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:09:23.692881 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:09:23.693496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:09:23.695481 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:23.695984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:23.696419 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:23.697116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:23.697568 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:23.698080 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:23.728758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:23.729778 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:23.730116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:23.731239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:23.732930 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:23.735123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:23.766700 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:23.799246 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Getting quotas for project 490f695240294bbaa99f5eaa1e32b977. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:09:23.807738 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Getting quotas for user 77fb76da34bf44a1b214a08bb4b8e51b and project 490f695240294bbaa99f5eaa1e32b977. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:09:23.828900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:09:23.831640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:09:23.892519 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:23.909261 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-676117bf-e65d-4ade-aaa6-9e845c7ed6f0 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.226796 Aug 31 04:09:23.913270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3c32e6c3-e5d2-4fdc-94d9-eba5db7c1e33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.440598 Aug 31 04:09:23.914323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 202/407] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:09:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 9443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:09:23.919195 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:23.928717 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:23.929408 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 206/408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:23 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:23.936777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:23.937331 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:23.937929 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:23.938684 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:23.939112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:23.940916 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e3d44835-cf62-4a8e-b675-1f19bd823859 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Action: 'create', calling method: .version_select at 0x7f88ad312820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1080942642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvXbga40JQp2XaJERpbB7fRQV7crNXJASMXflL04yFG4VvLgMWr5OilqDgH0fREQuhgf4sTMlCbeDfm8kh0tXs6UnRFaXJbOfzacZxDqJpBCCZry2EJehZynakjCWgvQ=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:23.946790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:23.982713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-e3d44835-cf62-4a8e-b675-1f19bd823859 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Getting quotas for project dfefc6f232404c6ca48d073df67c3907. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:09:23.992663 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-e3d44835-cf62-4a8e-b675-1f19bd823859 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Getting quotas for user 7129e53818ce43078fdea24108da5d39 and project dfefc6f232404c6ca48d073df67c3907. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:09:24.025439 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e3d44835-cf62-4a8e-b675-1f19bd823859 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.095188 Aug 31 04:09:24.026159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 207/409] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:09:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:24.053567 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d590a457-0cb6-439d-861f-ba34caad0146 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:24.054162 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d590a457-0cb6-439d-861f-ba34caad0146 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:24.299907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d590a457-0cb6-439d-861f-ba34caad0146 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:24.309283 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d590a457-0cb6-439d-861f-ba34caad0146 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1218 microversion: 2.1 time: 0.259570 Aug 31 04:09:24.310693 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 208/410] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:24 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1218 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:24.321825 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bab73d97-ac4b-4168-868a-b8a2a7e7ddf1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:24.322614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bab73d97-ac4b-4168-868a-b8a2a7e7ddf1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:24.430905 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bab73d97-ac4b-4168-868a-b8a2a7e7ddf1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:24.444802 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bab73d97-ac4b-4168-868a-b8a2a7e7ddf1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1244 microversion: 2.1 time: 0.132193 Aug 31 04:09:24.447450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 209/411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:24 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1244 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:24.456920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-296435067", "imageRef": "3039e041-ed99-4ef4-8268-79a206c5b563", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1080942642", "networks": [{"uuid": "cce3a859-4e9e-46fa-badb-7d5c4e79d14e"}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:24.482184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:24.505890 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:24.513156 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:24.515932 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1ee15a77-79ce-4570-a07e-21b9590c15df tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.600429 Aug 31 04:09:24.521675 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 203/412] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:23 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:24.598271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] validate_networks() for [('cce3a859-4e9e-46fa-badb-7d5c4e79d14e', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:09:24.932869 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:24.933742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:24.940637 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:24.941122 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:24.941550 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:24.942217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:24.942701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:24.943149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.159857 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:25.169811 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-33d0e336-3d80-40d8-aa43-838d51f626ab tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.240863 Aug 31 04:09:25.170405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 204/413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:24 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:25.206886 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:09:25.207432 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:09:25.207914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:09:25.208393 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:09:25.208956 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:09:25.219996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:25.220467 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:25.220908 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.221629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:25.222086 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:25.222515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.240562 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Getting quotas for project dfefc6f232404c6ca48d073df67c3907. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:09:25.244661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Getting quotas for user 7129e53818ce43078fdea24108da5d39 and project dfefc6f232404c6ca48d073df67c3907. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:09:25.256315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:09:25.258396 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3039e041-ed99-4ef4-8268-79a206c5b563',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:09:25.310297 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-488e2d3b-b652-4074-a949-fa5ae8cd84e7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860137 Aug 31 04:09:25.310914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 210/414] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:09:25.321704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15815916-0e84-4f5b-9855-655f8bb47e26 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:25.322302 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-15815916-0e84-4f5b-9855-655f8bb47e26 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:25.331688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:25.332360 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:25.343836 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:25.344348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:25.344756 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.345449 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:25.345898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:25.346320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.403447 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-15815916-0e84-4f5b-9855-655f8bb47e26 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:25.411056 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-15815916-0e84-4f5b-9855-655f8bb47e26 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1258 microversion: 2.1 time: 0.093206 Aug 31 04:09:25.411713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 205/415] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:25 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:25.425765 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:25.434923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-23ec8408-38f0-4ab3-aa88-afb704723f39 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1214 microversion: 2.1 time: 0.107008 Aug 31 04:09:25.435600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 211/416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:25 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:25.470450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:25.471123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:25.477539 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:25.478326 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:25.478964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.479989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:25.480641 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:25.481258 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.546996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:25.547639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:25.553674 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:25.554153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:25.554581 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.555298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:25.555921 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:25.556482 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:25.564202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:25.573680 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fc4c89ff-953c-4cd9-9be1-12cca8748349 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1248 microversion: 2.1 time: 0.107276 Aug 31 04:09:25.574406 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 206/417] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:25 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1248 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:25.783416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:25.798789 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:25.802778 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:25.804276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-79142577-642e-4945-87c6-8cf8a00823cc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.261361 Aug 31 04:09:25.807078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 212/418] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:25 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:26.190903 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:26.191540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:26.198952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.199477 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.199931 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.200618 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.201074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.201486 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.351936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:26.360336 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1b7c30ae-c63e-4b31-ad1f-5de7c0a278ce tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.173530 Aug 31 04:09:26.360911 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 207/419] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:26 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:26.435582 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:26.436519 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:26.446758 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.447603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.448369 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.449525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.449981 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.450395 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.455995 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:26.456599 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:26.463017 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.463530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.463949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.464697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.465126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.465923 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.469043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:26.530604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:26.541537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-412e195b-4ce7-4626-8681-87cca65f30a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1262 microversion: 2.1 time: 0.112840 Aug 31 04:09:26.542148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 213/420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:26 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1262 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:26.573089 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:26.581588 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a4bd14fe-cbc8-4289-87c8-14d6df15668d tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1214 microversion: 2.1 time: 0.129369 Aug 31 04:09:26.582334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 208/421] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:26 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:26.595840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:26.596766 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:26.606243 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.606730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.607198 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.607893 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.608346 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.608773 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.679896 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:26.688592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3b1c0d5b-957e-4121-8f67-04da3480cba1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1248 microversion: 2.1 time: 0.097177 Aug 31 04:09:26.689096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 214/422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:26 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1248 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:26.831926 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:26.832527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:26.834398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:26.839897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.840459 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.840878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:26.841556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:26.842000 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:26.842412 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.033384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:27.052166 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:27.054355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:27.055962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a5f116a8-c7b7-4c17-866e-457d89737c57 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.228303 Aug 31 04:09:27.072889 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 209/423] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:26 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:27.388865 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:27.389782 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:27.398515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:27.399692 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:27.400491 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.401450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:27.402320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:27.403164 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.564337 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:27.565067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:27.572543 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:27.573027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:27.573461 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.574157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:27.574981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:27.575455 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.860886 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:27.869902 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-813528ec-ab25-4303-bdd9-727bba1f2c70 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1310 microversion: 2.1 time: 0.309836 Aug 31 04:09:27.870787 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 210/424] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:27 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1310 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:27.876266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:27.876877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:27.882735 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:27.883257 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:27.883707 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.884562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:27.885161 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:27.885730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.969814 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:27.977653 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b6f727e8-231f-4183-a455-1ce4cc322377 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1278 microversion: 2.1 time: 0.105613 Aug 31 04:09:27.978381 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 211/425] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:27 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:27.982598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:27.983252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:27.989340 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:27.989830 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:27.990228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.990964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:27.991438 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:27.991851 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:27.992673 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:28.000622 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-267b9144-2c56-4674-91e3-478ff608607d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.617230 Aug 31 04:09:28.001427 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 215/426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:27 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:28.058962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:28.067684 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-967d9770-c951-4a29-8144-d30820904083 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1296 microversion: 2.1 time: 0.088609 Aug 31 04:09:28.068249 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 212/427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:27 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:28.084235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:28.084841 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:28.091062 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:28.091610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:28.092044 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:28.092723 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:28.093166 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:28.093583 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:28.226310 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:28.240193 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:28.242055 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:28.243459 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e973c502-b219-48b3-82bf-3a1a0059048a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.163105 Aug 31 04:09:28.244190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 216/428] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:28 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:28.895468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:28.896176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:28.914851 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:28.918548 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:28.919979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:28.923603 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:28.925551 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:28.927003 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.006252 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:29.007482 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:29.014842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.015642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.016257 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.017253 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.017857 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.018638 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.066164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:29.088400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-883dbbca-199f-4626-81c1-b15c011d8d5b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1316 microversion: 2.1 time: 0.197801 Aug 31 04:09:29.089468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 213/429] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:28 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:29.094773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:29.095403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:29.115326 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.116421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.117236 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.119357 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.121495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.122228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.275839 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:29.285412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4e6482a6-edcb-490e-ac51-c40aaafd75a7 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1276 microversion: 2.1 time: 0.287076 Aug 31 04:09:29.291796 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 217/430] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:28 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:29.308989 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:29.309771 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:29.334994 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.335641 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.336172 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.337053 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.337629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.338155 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.639406 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:29.666554 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-62a79566-a147-4fc4-8fd0-d40635ef83bb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1302 microversion: 2.1 time: 0.373305 Aug 31 04:09:29.668680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 218/431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:29 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1302 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:29.688502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:29.689484 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:29.713971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.716629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.717783 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.721682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.722341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.722951 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.808113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:29.816783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c34705d7-e32a-4946-9b32-0006e095ebed tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.725625 Aug 31 04:09:29.845176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 214/432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:29 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:29.868583 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-3cded1e0-1e87-4092-8f2b-9c3d24b60f47 req-c442d909-64c2-41ca-b66d-7ed87a4d921f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdae6298-1a2e-4f4a-88e0-32a21a1fed41", "name": "network-vif-plugged", "status": "completed", "tag": "4a5f6087-e036-48f1-876a-01f9c49bc717"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:29.884248 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3cded1e0-1e87-4092-8f2b-9c3d24b60f47 req-c442d909-64c2-41ca-b66d-7ed87a4d921f service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:29.885062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3cded1e0-1e87-4092-8f2b-9c3d24b60f47 req-c442d909-64c2-41ca-b66d-7ed87a4d921f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:29.885646 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3cded1e0-1e87-4092-8f2b-9c3d24b60f47 req-c442d909-64c2-41ca-b66d-7ed87a4d921f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:29.898326 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-3cded1e0-1e87-4092-8f2b-9c3d24b60f47 req-c442d909-64c2-41ca-b66d-7ed87a4d921f service nova] Creating event network-vif-plugged:4a5f6087-e036-48f1-876a-01f9c49bc717 for instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 on hv-cinder-85391 Aug 31 04:09:29.906383 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-3cded1e0-1e87-4092-8f2b-9c3d24b60f47 req-c442d909-64c2-41ca-b66d-7ed87a4d921f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042237 Aug 31 04:09:29.907614 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 215/433] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:30.123009 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:30.124253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:30.131881 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:30.132527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:30.133087 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:30.134675 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:30.135256 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:30.136995 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:30.326069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:30.341547 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3eb1d8be-af12-494a-a6b4-69455a61877c tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1316 microversion: 2.1 time: 0.228904 Aug 31 04:09:30.353927 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 216/434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:30 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:30.360669 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:30.361459 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:30.372736 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:30.377205 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:30.379744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:30.380499 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:30.388633 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:30.393190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:30.396551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-21f2b99e-1b28-4fc3-8478-5371d7e13fc7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.725868 Aug 31 04:09:30.397797 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 219/435] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:29 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:30.399854 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:30.400369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:30.400799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:30.704943 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:30.705666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:30.712213 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:30.717898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:30.718855 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:30.720042 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:30.721040 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:30.722411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:30.723215 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:30.727635 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-39f4774d-aa13-4677-a475-c82f0bace04e tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.370950 Aug 31 04:09:30.728502 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 217/436] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:30 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:30.860244 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:30.871168 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-df624dee-d0f3-47bc-b0e5-19d7ae0e1c92 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1302 microversion: 2.1 time: 0.176240 Aug 31 04:09:30.871338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 220/437] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:30 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1302 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:30.876676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:30.877664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:30.884037 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:30.884797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:30.886973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:30.887895 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:30.888384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:30.888816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:31.130875 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:31.141861 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5532c582-ac47-4ea7-b0f5-113f679531c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.269082 Aug 31 04:09:31.154472 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 218/438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:30 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:31.364136 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:31.365085 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:31.372201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:31.378095 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:31.383838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:31.385394 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:31.385934 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:31.386358 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:31.422153 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:31.423196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:31.430840 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:31.431660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:31.432265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:31.433460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:31.434085 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:31.434688 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:31.853637 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:31.856262 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:31.867741 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:31.868214 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d1fa4e81-2aaf-4591-bae5-75aa7b3c85c3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.508483 Aug 31 04:09:31.869646 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 221/439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:31 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:31.871289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:31.872791 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6e320b2f-8b85-4525-8169-bdc1225caaf3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.454907 Aug 31 04:09:31.873811 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 219/440] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:31 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:31.874731 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:31.875424 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:31.881947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:31.882613 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:31.883101 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:31.887381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:31.889091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:31.889091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:31.894260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:31.894866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:31.901033 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:31.901562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:31.901991 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:31.902691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:31.903341 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:31.903915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:32.136785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:32.141511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:32.150857 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ebf5213b-c2ff-42f4-b062-c70b2b18ff45 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.280025 Aug 31 04:09:32.151515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 222/441] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:31 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:32.152014 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cca73d9f-ec49-4f98-8e88-48fdd78b48ac tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.260651 Aug 31 04:09:32.166913 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 220/442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:31 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:32.172816 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:32.173423 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:32.179697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:32.180171 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:32.180591 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:32.181277 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:32.181718 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:32.182130 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:32.330319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:32.338694 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-de74debf-db1b-41ed-b17c-801cf8f8e0de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.169871 Aug 31 04:09:32.346752 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 223/443] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:32 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:32.889507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:32.890557 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:32.896255 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:32.897143 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:32.897953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:32.898616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:32.899124 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:32.899835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:32.900294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:32.900699 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:32.908230 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:32.909870 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:32.910395 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:32.910866 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:32.911747 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:32.912201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:32.912984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:33.128096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:33.136206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:33.141059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:33.142410 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:33.143639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9e36249c-c3a2-4a54-80a8-d35f1dfbccff tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.251822 Aug 31 04:09:33.144178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7b8cda5d-8e41-436b-b9c4-c14318417ddc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.258690 Aug 31 04:09:33.144701 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 224/444] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:32 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:33.145409 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 221/445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:32 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:33.173207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:33.173412 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:33.173903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:33.174028 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:33.181144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:33.181636 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:33.182064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:33.182796 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:33.183742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:33.183950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:33.184231 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:33.184353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:33.184660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:33.185355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:33.185961 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:33.186384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:33.417128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:33.420768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:33.426316 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4a778cce-29df-4107-9ae1-001a20dc1b2a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.256576 Aug 31 04:09:33.427358 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 222/446] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:33 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:33.432010 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:33.432902 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:33.439219 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:33.439734 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:33.440235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:33.441104 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:33.442526 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:33.443020 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:33.445769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8f5ee6f4-b9f5-48f8-b7dc-0f7b3b2099da tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.278040 Aug 31 04:09:33.447317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 225/447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:33 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:33.633691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:33.642903 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d601c86b-d341-468c-a172-f39f06e37a87 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.214572 Aug 31 04:09:33.655097 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 223/448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:33 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:34.166063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:34.167631 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:34.167937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:34.168542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:34.170380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:34.176028 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.176516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.177076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.177476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.177907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.178125 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.178493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.178595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.179065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.179344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.179796 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.180217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.376001 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:34.384930 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8b91cefb-25d4-44d4-88de-63e87e33dbab tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.222804 Aug 31 04:09:34.395176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 226/449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:34 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:34.438611 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:34.448049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:34.449646 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:34.451194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:34.451333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f299f95c-f659-4fa7-8d43-f5c22392b87a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.286821 Aug 31 04:09:34.454823 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:34.455000 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 224/450] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:34 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:34.458999 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.459516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.459960 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.465760 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.466453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.466877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.474855 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:34.475627 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:34.495202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.495826 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.496273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.497000 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.497449 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.497865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.704613 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:34.713227 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1632f50d-b2de-40da-ac41-24e960bf708f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.266502 Aug 31 04:09:34.720649 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 227/451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:34 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:34.722427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:34.729365 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:34.730438 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:34.732050 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-314d39f0-5d6e-451e-a95b-9f85a4dcebd4 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.261359 Aug 31 04:09:34.741856 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.742345 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.742843 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.743560 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:34.743818 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 225/452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:34 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:34.744079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:34.744493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:34.881897 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:34.890319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0cd184aa-44fc-4919-9cd1-e70877808292 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.168493 Aug 31 04:09:34.890934 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 228/453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:34 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:35.406529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:35.407296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:35.409567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=8 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:35.415894 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:35.416399 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:35.416834 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:35.417603 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:35.418054 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:35.418471 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:35.485347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:35.486103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:35.496033 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=4 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:35.496933 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=20 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:35.497667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:35.499603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:35.499800 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:35.500388 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:35.501280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:35.501838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:35.502393 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:35.611282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:35.621843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7d582222-2eb0-48b6-b34e-67f74bda5023 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.219175 Aug 31 04:09:35.631286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 226/454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:35 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:35.684352 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:35.693541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:35.694809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:35.696025 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-47197a1d-46d3-413c-ac7b-226ae5b95879 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.224449 Aug 31 04:09:35.696646 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 229/455] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:35 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:09:35.733868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:35.734757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:35.741345 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:35.741833 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:35.742328 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:35.743061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:35.743521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:35.743943 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:35.753919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:35.754529 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:35.761043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:35.761543 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:35.761971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:35.762672 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:35.763155 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:35.763941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:35.768351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:36.007786 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:36.015673 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:36.016963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4eaf6810-a20d-4b94-9c80-caf5067eba71 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.287006 Aug 31 04:09:36.031474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 227/456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:35 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:36.031474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:36.031474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:36.033007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-faf766a2-3d83-40ee-b1b1-144cc8d9031f tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.282708 Aug 31 04:09:36.033811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 230/457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:35 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:36.043069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:36.043883 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:36.044505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:36.045418 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:36.046034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:36.046626 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:36.195569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:36.203777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b4c1c5db-d0d4-42fe-8364-6d2595885829 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.183962 Aug 31 04:09:36.204363 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 228/458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:36 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:36.647438 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:36.648364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:36.656445 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:36.656919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:36.657344 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:36.658020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:36.658460 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:36.658875 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:36.720273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:36.720951 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:36.727957 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:36.728441 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:36.728877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:36.730556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:36.730556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:36.730556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:36.839802 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:36.847528 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b2a26fa4-81b8-4ab9-87b1-74ceecd6bc43 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.206772 Aug 31 04:09:36.848137 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 231/459] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:36 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:36.884778 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:36.894453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:36.895910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:36.897053 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6cf84967-b400-46ea-82b1-7212b56f45f7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.180829 Aug 31 04:09:36.897662 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 229/460] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:36 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:37.039397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:37.040011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:37.046493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.046975 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.047430 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.048109 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.048555 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.048971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.056616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:37.057224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:37.063579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.064073 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.064506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.065192 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.065632 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.066052 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.330893 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:37.338669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:37.340200 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-525b16ea-1345-4d32-9479-a300d5955fac tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.286856 Aug 31 04:09:37.340342 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 230/461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:37 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:37.351128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:37.351128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:37.351614 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.353383 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.353383 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.353383 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.353871 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.354278 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.359557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-cc1bbdee-d1e5-40aa-ab43-92905ee8b663 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.324075 Aug 31 04:09:37.360418 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 232/462] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:37 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:37.819978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:37.829452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-00167fb2-2714-4b92-a31c-f039f48c5a76 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.488071 Aug 31 04:09:37.830232 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 231/463] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:37 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:37.868843 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:37.869447 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:37.876523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.877512 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.877512 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.878138 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.878584 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.879077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.929542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:37.930157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:37.943207 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.943851 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.945399 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:37.946695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:37.947217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:37.947649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:38.336152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:38.344354 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3f45d7b8-f456-40f4-856f-caf0c4fa30d6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.479500 Aug 31 04:09:38.345010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 233/464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:37 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:38.360674 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:38.361268 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:38.367808 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:38.368310 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:38.368717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:38.369409 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:38.369890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:38.370279 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:38.375639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:38.393872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:38.395543 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:38.397367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4008dcda-5cbf-47f8-8ca2-1ef5ceffc25e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.472757 Aug 31 04:09:38.411474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 232/465] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:37 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:38.418859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:38.419511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:38.425968 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:38.426457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:38.426890 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:38.427621 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:38.428225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:38.428657 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:39.077182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:39.085352 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-424cc5ed-61df-4d95-bc99-b29f3eb53d38 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.728514 Aug 31 04:09:39.086069 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 234/466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:38 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:39.091223 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:39.091830 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:39.097777 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:39.098265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:39.098700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:39.099503 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:39.099957 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:39.100365 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:39.160261 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:39.169058 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ade04518-dd21-4bd5-af38-b51bdc6fc8c8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.756438 Aug 31 04:09:39.169868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 233/467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:38 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:39.366419 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:39.367145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:39.373211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:39.373773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:39.374277 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:39.375066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:39.375649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:39.376134 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:39.489160 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:39.497303 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c837aad2-6063-4987-b252-3c0b28e70241 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1365 microversion: 2.1 time: 0.409990 Aug 31 04:09:39.497874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 235/468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:39 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1365 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:39.504432 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:39.505036 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:39.510955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:39.511817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:39.512242 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:39.512929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:39.513371 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:39.513800 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:39.756403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:39.764743 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-81e17de3-821f-4018-883b-e48933cd7b4e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.402755 Aug 31 04:09:39.765413 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 234/469] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:39 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:39.782095 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-d3d10082-78e4-4b72-9986-5d7457ee3145 req-160add4e-9b6e-467a-9043-01f43dae7a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb2046f-ab11-422b-9573-3188818a82f8", "tag": "2b4e274a-7f96-4559-a287-f29400ea3c90"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:39.792418 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d3d10082-78e4-4b72-9986-5d7457ee3145 req-160add4e-9b6e-467a-9043-01f43dae7a5e service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:39.792877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d3d10082-78e4-4b72-9986-5d7457ee3145 req-160add4e-9b6e-467a-9043-01f43dae7a5e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:39.793331 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d3d10082-78e4-4b72-9986-5d7457ee3145 req-160add4e-9b6e-467a-9043-01f43dae7a5e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:39.812190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-d3d10082-78e4-4b72-9986-5d7457ee3145 req-160add4e-9b6e-467a-9043-01f43dae7a5e service nova] Creating event network-changed:2b4e274a-7f96-4559-a287-f29400ea3c90 for instance 4eb2046f-ab11-422b-9573-3188818a82f8 on hv-cinder-85391 Aug 31 04:09:39.817672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-d3d10082-78e4-4b72-9986-5d7457ee3145 req-160add4e-9b6e-467a-9043-01f43dae7a5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050954 Aug 31 04:09:39.818781 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 235/470] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:39.824739 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:39.834634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:39.836048 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:39.838320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6e603ec3-b7e2-41eb-ac8f-893640bd4b0c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.339008 Aug 31 04:09:39.839049 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 236/471] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:39 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:40.106726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:40.107685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:40.114459 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:40.115050 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:40.115629 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:40.116338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:40.116780 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:40.117192 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:40.193820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:40.194431 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:40.201332 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:40.201816 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:40.202245 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:40.202938 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:40.203418 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:40.203846 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:40.574594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:40.587804 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a75f8a65-2c0b-4480-9a23-4edec084f1c3 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.485527 Aug 31 04:09:40.588357 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 236/472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:40 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:40.600827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:40.601872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:40.608432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:40.608920 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:40.609352 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:40.610015 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:40.610670 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:40.611190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:40.707177 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:40.715069 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a084cfe7-9dc9-4cf4-83a2-c0e3423c5063 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.525073 Aug 31 04:09:40.715916 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 237/473] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:40 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:40.785384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:40.786159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:40.793023 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:40.793731 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:40.794343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:40.795256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:40.795710 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:40.796288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.365431 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:41.373515 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8aef17af-f57f-4967-93c1-8eb67c152d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1555 microversion: 2.1 time: 0.783915 Aug 31 04:09:41.374088 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 237/474] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:40 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1555 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:41.392827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:41.393427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:41.399474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.399966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.400389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.401070 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.401504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.401915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.420009 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:41.470478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:41.478288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-eb08108c-e34d-4825-8533-c5671fc28a8e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.696737 Aug 31 04:09:41.478901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 238/475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:40 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:41.483774 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-39fcb49b-f47e-44ae-a0a0-b7f351578b38 req-2aa25101-6f4b-4ba6-8eaa-37c2c97d9d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675abe1e-ac1e-458b-b5ac-745a7f6917b7", "name": "network-vif-plugged", "status": "completed", "tag": "4a38be32-98cb-48fd-b704-e08ed42a7fef"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:41.493661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-39fcb49b-f47e-44ae-a0a0-b7f351578b38 req-2aa25101-6f4b-4ba6-8eaa-37c2c97d9d20 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.494134 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-39fcb49b-f47e-44ae-a0a0-b7f351578b38 req-2aa25101-6f4b-4ba6-8eaa-37c2c97d9d20 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.494551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-39fcb49b-f47e-44ae-a0a0-b7f351578b38 req-2aa25101-6f4b-4ba6-8eaa-37c2c97d9d20 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.506284 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-39fcb49b-f47e-44ae-a0a0-b7f351578b38 req-2aa25101-6f4b-4ba6-8eaa-37c2c97d9d20 service nova] Creating event network-vif-plugged:4a38be32-98cb-48fd-b704-e08ed42a7fef for instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 on hv-cinder-85391 Aug 31 04:09:41.511497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-39fcb49b-f47e-44ae-a0a0-b7f351578b38 req-2aa25101-6f4b-4ba6-8eaa-37c2c97d9d20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031392 Aug 31 04:09:41.512117 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 239/476] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:41.517247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:41.517818 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:41.523934 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.524410 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.524835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.525526 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.525969 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.526416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.581059 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:41.589851 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:41.591286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:41.592541 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bade9cb6-f4f0-4689-ac0e-f44e2ffb1cdc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.217550 Aug 31 04:09:41.593088 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 238/477] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:41 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:41.608683 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:41.609291 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:41.615512 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.615861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-edc97d38-7217-4277-9446-48cbc25e454d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102484 Aug 31 04:09:41.615988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.616396 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.616534 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 240/478] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 31 04:09:41 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:41.617574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.618060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.618477 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.740177 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:41.740785 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:41.747453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.747936 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.748363 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.749043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:41.749492 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:41.749913 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:41.996976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:42.005117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-03aec572-b0e4-451c-9330-f6f748db4a59 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.400263 Aug 31 04:09:42.005676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 239/479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:41 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:42.010346 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-c375fa98-9c4a-4bfb-ba77-bbb0ef1d0b60 req-167d9677-b142-4cd9-a5f3-0f774e9f6e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2479a0a1-0225-4763-b228-5fedb5083ed2", "tag": "3b325145-3f6b-44c0-99d6-449f09ada113"}, {"name": "network-changed", "server_uuid": "cfefb434-dbeb-4fcc-8ebd-8603ee9beae9", "tag": "18837e08-59b6-49b1-b900-0ef749916fb5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:42.020940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c375fa98-9c4a-4bfb-ba77-bbb0ef1d0b60 req-167d9677-b142-4cd9-a5f3-0f774e9f6e1f service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:42.021422 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c375fa98-9c4a-4bfb-ba77-bbb0ef1d0b60 req-167d9677-b142-4cd9-a5f3-0f774e9f6e1f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:42.021849 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c375fa98-9c4a-4bfb-ba77-bbb0ef1d0b60 req-167d9677-b142-4cd9-a5f3-0f774e9f6e1f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:42.036472 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-c375fa98-9c4a-4bfb-ba77-bbb0ef1d0b60 req-167d9677-b142-4cd9-a5f3-0f774e9f6e1f service nova] Creating event network-changed:3b325145-3f6b-44c0-99d6-449f09ada113 for instance 2479a0a1-0225-4763-b228-5fedb5083ed2 on hv-cinder-85391 Aug 31 04:09:42.036982 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-c375fa98-9c4a-4bfb-ba77-bbb0ef1d0b60 req-167d9677-b142-4cd9-a5f3-0f774e9f6e1f service nova] Creating event network-changed:18837e08-59b6-49b1-b900-0ef749916fb5 for instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 on hv-cinder-85391 Aug 31 04:09:42.043735 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-c375fa98-9c4a-4bfb-ba77-bbb0ef1d0b60 req-167d9677-b142-4cd9-a5f3-0f774e9f6e1f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036691 Aug 31 04:09:42.044344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 240/480] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:42.069390 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:42.077749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-98f46bb4-fbcb-4dea-bb4e-90fffb5cf535 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.341836 Aug 31 04:09:42.078347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 241/481] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:41 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:42.499779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:42.500470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:42.506859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:42.507371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:42.507802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:42.508504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:42.508954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:42.509367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:42.617333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:42.617978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:42.625022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:42.625504 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:42.625914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:42.626607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:42.627059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:42.627561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:42.758713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:42.766872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-864479d1-3abb-4940-a1b2-d24c2bf0f2a0 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.272128 Aug 31 04:09:42.767741 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 241/482] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:42 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:42.891354 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:42.900494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:42.902000 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:42.903182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3f664df2-3556-4bea-a776-bd2d2cef6d44 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.289907 Aug 31 04:09:42.903802 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 242/483] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:42 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:43.026744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:43.027794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:43.034628 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:43.035101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:43.035537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:43.036338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:43.036695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:43.037152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:43.097995 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:43.098869 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:43.105955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:43.106653 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:43.107320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:43.107990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:43.108603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:43.109175 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:43.475450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:43.486905 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-240b3280-6d2c-40a1-845e-ab7d764deacb tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.462381 Aug 31 04:09:43.500582 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 242/484] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:43 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:43.524387 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:43.532772 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ce3913cf-b291-4f42-868e-8af5fd920ca8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.438646 Aug 31 04:09:43.533335 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 243/485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:43 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:43.787522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:43.788164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:43.795542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:43.796035 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:43.796468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:43.797153 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:43.804095 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:43.804631 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:43.927313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:43.927917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:43.934806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:43.935917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:43.936356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:43.937094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:43.937699 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:43.938128 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:43.951185 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:43.959605 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c9c3faf2-469e-4436-849f-8b9ad4cdf002 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.176009 Aug 31 04:09:43.960580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 243/486] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:43 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:44.065469 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-731e658b-d5ba-4412-a765-e92fabf58c34 req-9f75f25e-b26b-40c1-a29f-e5ee8bf5e4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdae6298-1a2e-4f4a-88e0-32a21a1fed41", "tag": "4a5f6087-e036-48f1-876a-01f9c49bc717"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:44.076947 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-731e658b-d5ba-4412-a765-e92fabf58c34 req-9f75f25e-b26b-40c1-a29f-e5ee8bf5e4d9 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:44.077429 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-731e658b-d5ba-4412-a765-e92fabf58c34 req-9f75f25e-b26b-40c1-a29f-e5ee8bf5e4d9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:44.077856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-731e658b-d5ba-4412-a765-e92fabf58c34 req-9f75f25e-b26b-40c1-a29f-e5ee8bf5e4d9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:44.091292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-731e658b-d5ba-4412-a765-e92fabf58c34 req-9f75f25e-b26b-40c1-a29f-e5ee8bf5e4d9 service nova] Creating event network-changed:4a5f6087-e036-48f1-876a-01f9c49bc717 for instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 on hv-cinder-85391 Aug 31 04:09:44.092347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:44.096760 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-731e658b-d5ba-4412-a765-e92fabf58c34 req-9f75f25e-b26b-40c1-a29f-e5ee8bf5e4d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034827 Aug 31 04:09:44.097405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 244/487] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:09:44.103168 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:44.104615 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:44.105775 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-17afdc2e-33f7-4c4a-9f36-d3c715daee70 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.182463 Aug 31 04:09:44.113154 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 244/488] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:43 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:44.508182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:44.508908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:44.516950 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:44.517932 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:44.518443 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:44.519507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:44.520286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:44.520977 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:44.554187 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:44.554698 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:44.561352 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:44.561748 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:44.562181 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:44.562929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:44.563458 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:44.563871 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:44.887405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:44.895795 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7497cd87-4c0c-4df2-ae95-bddcfcc0168a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.392181 Aug 31 04:09:44.896400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 245/489] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:44 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:44.901592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:44.909255 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e793f029-3a3a-4606-9c41-986ea706e429 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.359212 Aug 31 04:09:44.909823 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 245/490] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:44 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:44.980828 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:44.981569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:44.988123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:44.988610 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:44.989026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:44.989718 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:44.990168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:44.990587 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:45.129778 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:45.130376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:45.146881 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:45.147491 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:45.147926 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:45.148628 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:45.149077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:45.149639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:45.326610 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:45.335607 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8d13df8f-13aa-4973-bb69-6c0809e3e0b1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.358635 Aug 31 04:09:45.336310 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 246/491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:44 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:45.367008 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:45.375901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:45.377339 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:45.378508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6c97e50e-64c1-4715-bb32-cd1fc1c25ffd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.252684 Aug 31 04:09:45.379116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 246/492] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:45 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:09:45.426917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-ebb720e9-cc37-4d02-b72c-e4165fbec0cf req-e2e44221-9331-4ce0-9102-e20cb1a02791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2479a0a1-0225-4763-b228-5fedb5083ed2", "name": "network-vif-plugged", "status": "completed", "tag": "3b325145-3f6b-44c0-99d6-449f09ada113"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:45.436774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ebb720e9-cc37-4d02-b72c-e4165fbec0cf req-e2e44221-9331-4ce0-9102-e20cb1a02791 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:45.437250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ebb720e9-cc37-4d02-b72c-e4165fbec0cf req-e2e44221-9331-4ce0-9102-e20cb1a02791 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:45.437678 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ebb720e9-cc37-4d02-b72c-e4165fbec0cf req-e2e44221-9331-4ce0-9102-e20cb1a02791 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:45.449758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-ebb720e9-cc37-4d02-b72c-e4165fbec0cf req-e2e44221-9331-4ce0-9102-e20cb1a02791 service nova] Creating event network-vif-plugged:3b325145-3f6b-44c0-99d6-449f09ada113 for instance 2479a0a1-0225-4763-b228-5fedb5083ed2 on hv-cinder-85391 Aug 31 04:09:45.454535 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-ebb720e9-cc37-4d02-b72c-e4165fbec0cf req-e2e44221-9331-4ce0-9102-e20cb1a02791 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031336 Aug 31 04:09:45.455144 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 247/493] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:45.917058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:45.917741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:45.924412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:45.924825 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:45.925279 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:45.925974 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:45.926430 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:45.926852 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:45.931011 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:45.932179 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:45.938808 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:45.939318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:45.939744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:45.940428 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:45.940868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:45.941282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:46.249242 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:46.255505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:46.259454 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8199d9e8-38c7-4a78-ba6e-a76327ed6f6b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.346531 Aug 31 04:09:46.273036 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 247/494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:45 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:46.277579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:46.286199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad4c8314-5918-4c78-8b0d-fe9546d86875 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.359998 Aug 31 04:09:46.287325 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 248/495] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:45 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:46.356852 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:46.357561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:46.370067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:46.370539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:46.371391 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:46.372083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:46.372770 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:46.373198 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:46.401671 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:46.402290 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:46.408495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:46.409130 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:46.409810 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:46.410840 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:46.411599 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:46.412183 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:46.595280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:46.603927 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-483c6de9-dbb6-424a-b782-c1b02a1bd34d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.251132 Aug 31 04:09:46.617770 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 248/496] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:46 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:46.622474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:46.643451 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:46.645052 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:46.646573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-921f26eb-d30b-47fa-9f9b-2bac8b7472fc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1807 microversion: 2.20 time: 0.248841 Aug 31 04:09:46.647685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 249/497] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:46 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:09:47.281753 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:47.283328 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:47.290918 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:47.291825 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:47.292045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:47.293033 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:47.293680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:47.293899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:47.307489 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:47.308176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:47.315592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:47.316330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:47.316758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:47.317451 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:47.317894 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:47.318314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:47.578048 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:47.580823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:47.586350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7b19be37-b9cb-45c8-96e8-3562818c6d9b tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1318 microversion: 2.1 time: 0.309124 Aug 31 04:09:47.586919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 249/498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:47 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:47.588733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f799208b-98ea-4e27-94c3-d0aff270efcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.285584 Aug 31 04:09:47.589279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 250/499] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:47 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:47.624447 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:47.625041 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:47.631372 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:47.631846 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:47.632267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:47.632944 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:47.633383 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:47.633792 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:47.669891 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:47.670622 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:47.677205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:47.677760 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:47.678222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:47.678920 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:47.679414 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:47.679834 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:47.814269 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:47.822207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-39ef56b5-86af-4ec2-8d64-6b830d963eaf tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.201233 Aug 31 04:09:47.822934 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 250/500] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:47 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:47.843584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:47.852460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:47.854254 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:47.855451 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7a70f297-65fd-41f2-b753-59ba5859a007 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1794 microversion: 2.20 time: 0.189526 Aug 31 04:09:47.856018 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 251/501] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:09:47 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1794 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:09:48.297201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-6343bad4-480b-4410-bfe8-db1693675b88 req-16cc8411-5f4e-43ae-b374-44d110b326fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb2046f-ab11-422b-9573-3188818a82f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b4e274a-7f96-4559-a287-f29400ea3c90"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:48.311935 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-6343bad4-480b-4410-bfe8-db1693675b88 req-16cc8411-5f4e-43ae-b374-44d110b326fa service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:48.312643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-6343bad4-480b-4410-bfe8-db1693675b88 req-16cc8411-5f4e-43ae-b374-44d110b326fa service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:48.313224 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-6343bad4-480b-4410-bfe8-db1693675b88 req-16cc8411-5f4e-43ae-b374-44d110b326fa service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:48.326072 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-6343bad4-480b-4410-bfe8-db1693675b88 req-16cc8411-5f4e-43ae-b374-44d110b326fa service nova] Creating event network-vif-plugged:2b4e274a-7f96-4559-a287-f29400ea3c90 for instance 4eb2046f-ab11-422b-9573-3188818a82f8 on hv-cinder-85391 Aug 31 04:09:48.333022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-6343bad4-480b-4410-bfe8-db1693675b88 req-16cc8411-5f4e-43ae-b374-44d110b326fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039744 Aug 31 04:09:48.333660 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 251/502] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:48.606334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:48.607045 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:48.609478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:48.610628 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:48.613961 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:48.614447 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:48.614878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:48.615598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:48.616047 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:48.616468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:48.616684 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:48.617157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:48.617580 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:48.618274 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:48.618711 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:48.619157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:49.070597 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:49.074763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:49.079657 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d877aa0-5087-43a4-b6c2-3d1caeea9849 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1508 microversion: 2.1 time: 0.477521 Aug 31 04:09:49.080234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 252/503] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:48 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1508 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:49.083531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-eebfe7df-2dac-463f-804a-8fbbcae257ee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.478120 Aug 31 04:09:49.084427 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 252/504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:48 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:49.084887 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:49.085488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:49.091788 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:49.092280 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:49.092707 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:49.093389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:49.093832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:49.094245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:49.101883 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "245a4795-a629-4f26-b72e-dbb800208837", "device": "/dev/sdb"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:49.104479 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:49.110635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:49.111188 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:49.111940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:49.112632 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:49.113084 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:49.113501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:49.223643 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:49.231447 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f03b561a-1910-4b8f-952c-b8955dc68a34 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1358 microversion: 2.1 time: 0.150048 Aug 31 04:09:49.232025 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 253/505] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:49 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:49.557120 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6bf41cbd-7c7d-44a6-887c-3b07692f28df tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "POST /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458772 Aug 31 04:09:49.557777 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 253/506] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:09:49 2022] POST /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:50.108374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:50.109366 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:50.114141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:09:50.114421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Wed Aug 31 04:09:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 (ip 10.222.0.18) !!! Aug 31 04:09:50.123378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.123863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.124276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.124964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.125409 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.125826 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.253216 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:50.253933 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:50.261336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.262130 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.262722 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.263627 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.273174 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:50.276872 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.281343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8db4bd45-e7a4-4f8b-8dd8-76da5ae5652c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.179417 Aug 31 04:09:50.282222 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.287530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 254/507] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:50 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:50.354625 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f7a39233-e840-47e6-90fa-f76034217b65 req-3da69171-b2ff-4772-bace-26dbe32bd64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfefb434-dbeb-4fcc-8ebd-8603ee9beae9", "name": "network-vif-plugged", "status": "completed", "tag": "18837e08-59b6-49b1-b900-0ef749916fb5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:50.364982 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f7a39233-e840-47e6-90fa-f76034217b65 req-3da69171-b2ff-4772-bace-26dbe32bd64f service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.365486 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f7a39233-e840-47e6-90fa-f76034217b65 req-3da69171-b2ff-4772-bace-26dbe32bd64f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.365875 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f7a39233-e840-47e6-90fa-f76034217b65 req-3da69171-b2ff-4772-bace-26dbe32bd64f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.377647 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f7a39233-e840-47e6-90fa-f76034217b65 req-3da69171-b2ff-4772-bace-26dbe32bd64f service nova] Creating event network-vif-plugged:18837e08-59b6-49b1-b900-0ef749916fb5 for instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 on hv-cinder-85391 Aug 31 04:09:50.383455 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f7a39233-e840-47e6-90fa-f76034217b65 req-3da69171-b2ff-4772-bace-26dbe32bd64f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032500 Aug 31 04:09:50.384094 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 255/508] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:50.425138 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:50.433124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ad6210fb-5eee-4f34-b339-201f69e49efe tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1548 microversion: 2.1 time: 0.184300 Aug 31 04:09:50.433716 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 254/509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:50 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:50.454693 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:50.455453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:50.461540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.462026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.462459 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.463377 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.463832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.464290 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.658520 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:50.667114 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ed5885d6-e3b7-4a9f-8e8f-ed1ec6d85626 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1548 microversion: 2.1 time: 0.216951 Aug 31 04:09:50.667888 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 256/510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:50 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:50.688398 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:50.694451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:50.695645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Searching by: {'deleted': False, 'project_id': 'dfefc6f232404c6ca48d073df67c3907'} {{(pid=120661) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 04:09:50.705263 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.705903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.706389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.707510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.708177 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.708649 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.803986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.multi_cell_list [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120661) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 04:09:50.896082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1b571c57-3256-4fde-a340-7199c3bdf985 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211356 Aug 31 04:09:50.896566 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 255/511] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Aug 31 04:09:50 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:50.908265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:50.908937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:50.915665 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.916148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.916611 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:50.917273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:50.917859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:50.918295 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:51.056115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:51.059784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:51.065181 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f7115b5c-8649-4a42-91e5-f23d5b2d3500 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1548 microversion: 2.1 time: 0.160899 Aug 31 04:09:51.065754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 257/512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:50 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:51.307550 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:51.308564 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:51.315431 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:51.315908 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:51.316343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:51.317037 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:51.317480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:51.318101 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:51.464700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:51.472406 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8bc07c3b-a1e5-4216-86ec-159b0e80aace tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.168743 Aug 31 04:09:51.472941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 256/513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:51 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:09:52.492831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:52.493417 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:52.500726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:52.501218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:52.501653 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:52.502347 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:52.502802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:52.503265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:52.643393 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:52.646830 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb66874c-7505-4436-a379-fe807124f95d"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:52.649315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:52.655019 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6e4faea3-7803-4ac5-b774-aa62da78771c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1369 microversion: 2.1 time: 0.165963 Aug 31 04:09:52.656202 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:52.656698 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:52.657194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:52.657738 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 258/514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:52 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:52.657959 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:52.658409 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:52.658831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:52.924208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5f22802a-166e-4d62-83d3-ebc96f1e48bd tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "POST /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281132 Aug 31 04:09:52.924828 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 257/515] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:09:52 2022] POST /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:09:53.681129 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:53.682048 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:53.684831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:53.690514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:53.690981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:53.691511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:53.692223 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:53.692667 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:53.693079 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:53.828219 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:09:53.836466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dc4e1e44-4435-4185-8866-d6687e6f130f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1564 microversion: 2.1 time: 0.161763 Aug 31 04:09:53.837047 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 259/516] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:09:53 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:09:53.857249 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:09:53.857800 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:09:53.865083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:53.865559 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:53.865984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:53.866668 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:53.867148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:53.867545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:53.956632 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0459b1ff-aa42-4475-89d6-ed627d1a8bee tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103218 Aug 31 04:09:53.957533 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 258/517] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 31 04:09:53 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:09:54.938046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-4d4c58b5-09f9-4f69-9722-06556adc3473 req-feaa13b4-1ae0-42c7-889f-073db6c523eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfefb434-dbeb-4fcc-8ebd-8603ee9beae9", "tag": "18837e08-59b6-49b1-b900-0ef749916fb5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:09:54.948093 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4d4c58b5-09f9-4f69-9722-06556adc3473 req-feaa13b4-1ae0-42c7-889f-073db6c523eb service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:09:54.948860 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4d4c58b5-09f9-4f69-9722-06556adc3473 req-feaa13b4-1ae0-42c7-889f-073db6c523eb service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:09:54.949276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4d4c58b5-09f9-4f69-9722-06556adc3473 req-feaa13b4-1ae0-42c7-889f-073db6c523eb service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:09:54.960386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-4d4c58b5-09f9-4f69-9722-06556adc3473 req-feaa13b4-1ae0-42c7-889f-073db6c523eb service nova] Creating event network-changed:18837e08-59b6-49b1-b900-0ef749916fb5 for instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 on hv-cinder-85391 Aug 31 04:09:54.965450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-4d4c58b5-09f9-4f69-9722-06556adc3473 req-feaa13b4-1ae0-42c7-889f-073db6c523eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031167 Aug 31 04:09:54.966294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 260/518] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:06.983523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:06.984334 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=59 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:06.985070 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:06.989873 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:06.990545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:06.998585 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:06.999156 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:06.999583 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:07.000262 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:07.000704 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:07.001194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:07.147081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:07.159007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-955498c3-bcff-4fbc-a2cd-7f51a4ee8bb2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1594 microversion: 2.1 time: 0.177077 Aug 31 04:10:07.160046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 259/519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:06 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1594 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:09.212315 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-440be096-2315-4585-bff5-080b6e0375f1 req-b0cb0a51-158e-435f-9579-e329c6c8f821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb2046f-ab11-422b-9573-3188818a82f8", "tag": "2b4e274a-7f96-4559-a287-f29400ea3c90"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:09.218440 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:09.219105 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=14 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:09.225397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-440be096-2315-4585-bff5-080b6e0375f1 req-b0cb0a51-158e-435f-9579-e329c6c8f821 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:09.225875 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-440be096-2315-4585-bff5-080b6e0375f1 req-b0cb0a51-158e-435f-9579-e329c6c8f821 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:09.226305 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-440be096-2315-4585-bff5-080b6e0375f1 req-b0cb0a51-158e-435f-9579-e329c6c8f821 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:09.239335 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-440be096-2315-4585-bff5-080b6e0375f1 req-b0cb0a51-158e-435f-9579-e329c6c8f821 service nova] Creating event network-changed:2b4e274a-7f96-4559-a287-f29400ea3c90 for instance 4eb2046f-ab11-422b-9573-3188818a82f8 on hv-cinder-85391 Aug 31 04:10:09.244433 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-440be096-2315-4585-bff5-080b6e0375f1 req-b0cb0a51-158e-435f-9579-e329c6c8f821 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036091 Aug 31 04:10:09.245359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 261/520] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:10.156482 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:10.157021 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:10.164013 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:10.164494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:10.164920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:10.165606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:10.166065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:10.166464 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:10.258215 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lazy-loading 'services' on Instance uuid 2479a0a1-0225-4763-b228-5fedb5083ed2 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:10:10.323759 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1512982465"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:10.324996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:10.331933 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:10.332640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:10.333230 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:10.334094 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:10.334696 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:10.335155 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:10.344955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-cea9ac4f-83f5-41eb-8ffd-80743a6eb79a tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2/os-volume_attachments/245a4795-a629-4f26-b72e-dbb800208837" status: 202 len: 0 microversion: 2.1 time: 0.192336 Aug 31 04:10:10.345646 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 260/521] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:10:10 2022] DELETE /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2/os-volume_attachments/245a4795-a629-4f26-b72e-dbb800208837 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:10:10.509313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.network.security_group_api [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Adding security group 1dfbc972-4426-4788-bce2-d653baa582a2 to port 2b4e274a-7f96-4559-a287-f29400ea3c90 Aug 31 04:10:10.865030 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5ca43be8-cae2-4a76-8afd-2f870c65313b tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "POST /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/action" status: 202 len: 0 microversion: 2.1 time: 0.547293 Aug 31 04:10:10.865734 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 262/522] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:10:10 2022] POST /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 04:10:10.875900 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:10.876606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:10.883329 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:10.883801 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:10.884230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:10.884936 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:10.885549 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:10.886096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:11.050706 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:11.067702 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d89ed409-3c49-4984-9351-ce74c138e979 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1760 microversion: 2.1 time: 0.196057 Aug 31 04:10:11.068347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 261/523] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:10 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:11.261756 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-349860a9-8666-4735-a37d-8d32e4c2062e req-60d51c67-330e-4bf5-95cf-5468a04f2a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb2046f-ab11-422b-9573-3188818a82f8", "tag": "2b4e274a-7f96-4559-a287-f29400ea3c90"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:11.275276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-349860a9-8666-4735-a37d-8d32e4c2062e req-60d51c67-330e-4bf5-95cf-5468a04f2a55 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:11.275771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-349860a9-8666-4735-a37d-8d32e4c2062e req-60d51c67-330e-4bf5-95cf-5468a04f2a55 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:11.277034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-349860a9-8666-4735-a37d-8d32e4c2062e req-60d51c67-330e-4bf5-95cf-5468a04f2a55 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:11.289205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-349860a9-8666-4735-a37d-8d32e4c2062e req-60d51c67-330e-4bf5-95cf-5468a04f2a55 service nova] Creating event network-changed:2b4e274a-7f96-4559-a287-f29400ea3c90 for instance 4eb2046f-ab11-422b-9573-3188818a82f8 on hv-cinder-85391 Aug 31 04:10:11.294874 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-349860a9-8666-4735-a37d-8d32e4c2062e req-60d51c67-330e-4bf5-95cf-5468a04f2a55 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037956 Aug 31 04:10:11.295534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 263/524] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:11.508929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:11.510950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:11.518553 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:11.519127 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:11.519594 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:11.520963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:11.521641 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:11.522344 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:11.564955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:10:11.650154 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f911303e-c439-4da6-b779-46c684a14ae6 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 204 len: 0 microversion: 2.1 time: 0.146318 Aug 31 04:10:11.652571 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 262/525] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:10:11 2022] DELETE /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:10:11.662932 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:11.664327 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:11.671372 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:11.671869 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:11.672297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:11.673000 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:11.673453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:11.673877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:11.816367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:11.826634 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6f148e1b-e403-43fd-a800-2679ba651719 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1514 microversion: 2.1 time: 0.169101 Aug 31 04:10:11.827511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 264/526] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:11 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:12.852186 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:12.853036 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:12.861849 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:12.862453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:12.862996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:12.863815 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:12.864475 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:12.864907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:13.010644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:13.019599 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-2a2e03c1-c32b-4f03-b467-5e829b1ce1e0 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1514 microversion: 2.1 time: 0.172723 Aug 31 04:10:13.020177 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 263/527] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:12 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:14.041510 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:14.042090 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:14.049244 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:14.049754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:14.050183 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:14.050885 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:14.051376 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:14.051799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:14.211065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:14.220009 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a461e4dc-24bb-4a69-9422-34859e265815 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1514 microversion: 2.1 time: 0.182472 Aug 31 04:10:14.220567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 265/528] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:14 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:14.754427 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-fbd82261-5762-430b-bf22-28378b967af3 req-23054e40-278e-46c5-b65c-95fff30bd72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2479a0a1-0225-4763-b228-5fedb5083ed2", "name": "network-vif-deleted", "tag": "3b325145-3f6b-44c0-99d6-449f09ada113"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:14.766656 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-fbd82261-5762-430b-bf22-28378b967af3 req-23054e40-278e-46c5-b65c-95fff30bd72b service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:14.767284 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-fbd82261-5762-430b-bf22-28378b967af3 req-23054e40-278e-46c5-b65c-95fff30bd72b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:14.767826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-fbd82261-5762-430b-bf22-28378b967af3 req-23054e40-278e-46c5-b65c-95fff30bd72b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:14.782612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-fbd82261-5762-430b-bf22-28378b967af3 req-23054e40-278e-46c5-b65c-95fff30bd72b service nova] Creating event network-vif-deleted:3b325145-3f6b-44c0-99d6-449f09ada113 for instance 2479a0a1-0225-4763-b228-5fedb5083ed2 on hv-cinder-85391 Aug 31 04:10:14.787931 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-fbd82261-5762-430b-bf22-28378b967af3 req-23054e40-278e-46c5-b65c-95fff30bd72b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037138 Aug 31 04:10:14.788612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 264/529] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:15.247072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:15.247761 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:15.254866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:15.255410 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:15.255836 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:15.256541 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:15.256985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:15.257399 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:15.296381 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:15.297025 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:15.297467 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:15.297929 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lazy-loading 'fault' on Instance uuid 2479a0a1-0225-4763-b228-5fedb5083ed2 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:10:15.348094 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdeb3e2f0ec411682815e1d4197f662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd362e24b36234e6b9a62f07a06dcd9f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:15.358518 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cae924a4-43a0-4267-8b8f-25215d9cf6f5 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 200 len: 1308 microversion: 2.1 time: 0.115011 Aug 31 04:10:15.359326 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 266/530] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:15 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:16.381400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:16.382091 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] [instance: 2479a0a1-0225-4763-b228-5fedb5083ed2] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:16.389026 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:16.389500 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:16.389919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:16.390601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:16.391065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:16.391491 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:16.405188 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] HTTP exception thrown: Instance 2479a0a1-0225-4763-b228-5fedb5083ed2 could not be found. Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Request method failure captured: Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 HTTP/1.1 Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt6LaUyAiRAQJz9RB3nMmHos4stUfDXx8fxx4a-yxrlrJf8t-_1C2ziqIAbEmoQcoLZwH3I0LvIGvnWKOqo2swtNWs5xIRlalh4Hh1oqSiLYQpT2JpNjiTCPuoybox5RKCGTTEijfmtDDge5fDlvVxWlzEQmGQFa8JqdoSNScZqcLsc Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: d362e24b36234e6b9a62f07a06dcd9f3 Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1513228801 Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:10:16.406898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d362e24b36234e6b9a62f07a06dcd9f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d362e24b36234e6b9a62f07a06dcd9f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d362e24b36234e6b9a62f07a06dcd9f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d362e24b36234e6b9a62f07a06dcd9f3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-VolumesSnapshotTestJSON-1513228801 Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: d362e24b36234e6b9a62f07a06dcd9f3 Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1513228801 Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-VolumesSnapshotTestJSON-1513228801-project Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: ffdeb3e2f0ec411682815e1d4197f662 Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-VolumesSnapshotTestJSON-1513228801-project Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 2479a0a1-0225-4763-b228-5fedb5083ed2 could not be found. Aug 31 04:10:16.408513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '2479a0a1-0225-4763-b228-5fedb5083ed2'} Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2479a0a1-0225-4763-b228-5fedb5083ed2 could not be found. Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:10:16.409337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2479a0a1-0225-4763-b228-5fedb5083ed2 could not be found. Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2479a0a1-0225-4763-b228-5fedb5083ed2 could not be found. Aug 31 04:10:16.410601 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:16.411728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] Returning 404 to user: Instance 2479a0a1-0225-4763-b228-5fedb5083ed2 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:10:16.411728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f3926833-98cf-4422-b2cf-8f90fdfa1535 tempest-VolumesSnapshotTestJSON-1513228801 tempest-VolumesSnapshotTestJSON-1513228801-project] 10.222.0.18 "GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2" status: 404 len: 111 microversion: 2.1 time: 0.031611 Aug 31 04:10:16.411728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 265/531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:16 2022] GET /compute/v2.1/servers/2479a0a1-0225-4763-b228-5fedb5083ed2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:10:38.505005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:38.505978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:38.509209 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=14 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:38.510258 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=28 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:38.517988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.518491 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.518911 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.519633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.520087 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.520508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.545446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e187a5bf-c6b1-4317-8a35-42587363c2b9 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41/ips" status: 200 len: 149 microversion: 2.1 time: 0.047124 Aug 31 04:10:38.545941 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 267/532] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:10:38 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:38.560079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f21c0be-ccd3-4987-b1c3-2afc36a97662"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:38.563513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:38.567389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:38.568116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:38.575552 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.576032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.576455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.577149 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.577596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.578011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.664085 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Invalid volume: volume 5f21c0be-ccd3-4987-b1c3-2afc36a97662 is already attached to instances: 8e5504b0-52b4-4d1a-a67b-6d6e26053371 Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: POST /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41/os-volume_attachments HTTP/1.1 Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 74 Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:10:38.665681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {"volumeAttachment": {"volumeId": "5f21c0be-ccd3-4987-b1c3-2afc36a97662"}} Aug 31 04:10:38.667356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Invalid volume: volume 5f21c0be-ccd3-4987-b1c3-2afc36a97662 is already attached to instances: 8e5504b0-52b4-4d1a-a67b-6d6e26053371 Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'server_id': 'fdae6298-1a2e-4f4a-88e0-32a21a1fed41', 'body': {'volumeAttachment': {'volumeId': '5f21c0be-ccd3-4987-b1c3-2afc36a97662'}}} Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5f21c0be-ccd3-4987-b1c3-2afc36a97662 is already attached to instances: 8e5504b0-52b4-4d1a-a67b-6d6e26053371 Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:38.668397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5f21c0be-ccd3-4987-b1c3-2afc36a97662 is already attached to instances: 8e5504b0-52b4-4d1a-a67b-6d6e26053371 Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:38.670521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:38.672190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:38.672190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:10:38.672190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:10:38.672190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5f21c0be-ccd3-4987-b1c3-2afc36a97662 is already attached to instances: 8e5504b0-52b4-4d1a-a67b-6d6e26053371 Aug 31 04:10:38.672190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:38.672190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 400 to user: Invalid volume: volume 5f21c0be-ccd3-4987-b1c3-2afc36a97662 is already attached to instances: 8e5504b0-52b4-4d1a-a67b-6d6e26053371 {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:10:38.672190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b7c8417f-2a77-485e-bffa-a508927c767f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113245 Aug 31 04:10:38.672190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 266/533] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:10:38 2022] POST /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:10:38.677857 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:38.678339 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:38.685201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.685731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.686167 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.686824 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.687338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.687757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.712369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:10:38.794538 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-575018a5-bc8b-4a92-afa8-936ba31ca7dd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 204 len: 0 microversion: 2.1 time: 0.120109 Aug 31 04:10:38.795614 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 268/534] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:10:38 2022] DELETE /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:10:38.803765 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:38.804398 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:38.811677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.812160 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.812590 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.813310 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.813827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.814251 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.816479 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:38.817250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:38.823192 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.823676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.824120 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.824800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.825879 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.826021 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.858425 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fb9d8f16-86c7-4a5b-8d53-9465038ace4f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments/a8feb5f7-6edb-48a2-a8f6-3e361ba5987d" status: 200 len: 194 microversion: 2.20 time: 0.046171 Aug 31 04:10:38.859050 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 269/535] 10.222.0.18 () {60 vars in 1454 bytes} [Wed Aug 31 04:10:38 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments/a8feb5f7-6edb-48a2-a8f6-3e361ba5987d => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:10:38.928475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:38.928981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:38.935113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.935594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.936030 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.936713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:38.937159 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:38.937577 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:38.950515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:38.958329 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ef7555db-c24d-4ef2-b10a-9759da154f47 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1679 microversion: 2.1 time: 0.158431 Aug 31 04:10:38.958906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 267/536] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:38 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:39.064617 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lazy-loading 'services' on Instance uuid 675abe1e-ac1e-458b-b5ac-745a7f6917b7 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:10:39.183222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7487c9b8-35fa-450f-8d43-7effc8a1374a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "DELETE /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments/a8feb5f7-6edb-48a2-a8f6-3e361ba5987d" status: 202 len: 0 microversion: 2.20 time: 0.258612 Aug 31 04:10:39.183823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 270/537] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Aug 31 04:10:38 2022] DELETE /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments/a8feb5f7-6edb-48a2-a8f6-3e361ba5987d => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:10:39.192214 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:39.194325 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:39.200480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:39.201026 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:39.201453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:39.202141 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:39.202584 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:39.202991 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:39.232855 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4d7f15cb-c5ab-4a6c-b1bc-c37324a38d50 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044544 Aug 31 04:10:39.233383 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 268/538] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 31 04:10:39 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:10:39.983621 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:39.984292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:39.991279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:39.991806 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:39.992239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:39.992921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:39.993364 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:39.993793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:40.140001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:40.150270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7149b5e4-2afc-45c7-916e-15a223ecb81d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1679 microversion: 2.1 time: 0.172529 Aug 31 04:10:40.151637 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 271/539] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:39 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:10:40.246051 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:40.248364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:40.254767 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:40.255297 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:40.255753 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:40.256419 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:40.256860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:40.257278 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:40.290002 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3c0266ca-937b-46b6-874b-c5965471c762 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047883 Aug 31 04:10:40.290640 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 269/540] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 31 04:10:40 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:10:41.172260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:41.172866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:41.179728 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:41.180219 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:41.180643 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:41.181342 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:41.181772 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:41.182186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:41.304496 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:41.306771 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:41.314065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:41.314530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:41.315017 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:41.315772 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:41.316219 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:41.316634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:41.349175 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f9d1da54-62b2-4ece-b84e-c009d03c6849 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048743 Aug 31 04:10:41.349752 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 270/541] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 31 04:10:41 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:41.415326 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:41.415959 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:41.422579 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:41.423088 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:41.423615 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:41.424382 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:41.424903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:41.425387 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:41.452349 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:10:41.536102 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-cc14b583-0572-4c54-ab41-9291b6c2b625 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "DELETE /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 204 len: 0 microversion: 2.20 time: 0.124449 Aug 31 04:10:41.539843 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 271/542] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 31 04:10:41 2022] DELETE /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 04:10:41.546141 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:41.547038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:41.553250 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:41.553739 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:41.554171 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:41.554874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:41.555353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:41.555802 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:41.658184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:41.667224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a126440c-26f6-4217-aaca-5dcd6a05629b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1679 microversion: 2.1 time: 0.499182 Aug 31 04:10:41.668457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 272/543] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:41 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1679 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:41.847163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:41.856115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:41.858142 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:41.859420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-35682212-be4d-4f72-8635-f7d69bb6571e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.318225 Aug 31 04:10:41.860602 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 272/544] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:41 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:10:42.160710 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-04f501ce-3460-462c-92d5-b119a5fdb1f2 req-5aedbb1e-ccf2-4df6-b675-1afed21a1cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdae6298-1a2e-4f4a-88e0-32a21a1fed41", "name": "network-vif-deleted", "tag": "4a5f6087-e036-48f1-876a-01f9c49bc717"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:42.171799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-04f501ce-3460-462c-92d5-b119a5fdb1f2 req-5aedbb1e-ccf2-4df6-b675-1afed21a1cc2 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:42.172592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-04f501ce-3460-462c-92d5-b119a5fdb1f2 req-5aedbb1e-ccf2-4df6-b675-1afed21a1cc2 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:42.173178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-04f501ce-3460-462c-92d5-b119a5fdb1f2 req-5aedbb1e-ccf2-4df6-b675-1afed21a1cc2 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:42.184753 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-04f501ce-3460-462c-92d5-b119a5fdb1f2 req-5aedbb1e-ccf2-4df6-b675-1afed21a1cc2 service nova] Creating event network-vif-deleted:4a5f6087-e036-48f1-876a-01f9c49bc717 for instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 on hv-cinder-85391 Aug 31 04:10:42.190473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-04f501ce-3460-462c-92d5-b119a5fdb1f2 req-5aedbb1e-ccf2-4df6-b675-1afed21a1cc2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Aug 31 04:10:42.191556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 273/545] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:42.404229 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cb355a8-737a-4688-a754-51ba56f2178e"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:42.408052 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:42.430148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:42.431090 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:42.431741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:42.432456 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:42.433140 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:42.434000 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:42.691327 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:42.692391 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:42.699424 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:42.700028 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:42.700967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:42.702499 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:42.703356 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:42.710942 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:42.789958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:42.802531 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca591164-049b-4b05-b928-2abd0829e525 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1611 microversion: 2.1 time: 0.115318 Aug 31 04:10:42.803752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 274/546] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:42 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1611 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:10:42.883760 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:42.884653 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:42.891075 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:42.891906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:42.892570 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:42.893529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:42.894189 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:42.894816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:43.115306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:43.128473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:43.130420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:43.133023 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7a249e7c-d3f8-4c3a-9ff9-dd40b0a16a73 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.253306 Aug 31 04:10:43.134376 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 275/547] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:42 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:10:43.302453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-970a777b-9fb8-4b31-9495-8895d8535555 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902801 Aug 31 04:10:43.313734 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 273/548] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:10:42 2022] POST /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:43.825135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:43.826304 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:43.842064 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:43.842788 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:43.843415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:43.844284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:43.849300 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:43.849962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:43.917418 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:43.917914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:43.918335 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:43.918840 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lazy-loading 'fault' on Instance uuid fdae6298-1a2e-4f4a-88e0-32a21a1fed41 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:10:44.008175 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:44.021775 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cf3def29-abcf-40d5-b00b-ed17d86c7dac tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 200 len: 1329 microversion: 2.1 time: 0.200375 Aug 31 04:10:44.022690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 276/549] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:43 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 1329 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:44.169856 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:44.174575 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:44.186476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:44.187328 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:44.187981 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:44.188848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:44.189456 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:44.190023 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:44.273837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:44.277224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:44.285180 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:44.286048 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:44.286835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:44.288064 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:44.289189 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:44.289907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:44.418650 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a8f30a56-d7a5-4121-9879-e198609ddd3d tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "POST /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/action" status: 202 len: 0 microversion: 2.1 time: 0.148607 Aug 31 04:10:44.422383 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 277/550] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:10:44 2022] POST /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 04:10:44.429308 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:44.430432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:44.438148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:44.438666 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:44.439198 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:44.440387 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:44.441317 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:44.442339 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:44.646800 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:44.658111 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:44.659667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:44.665769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5ae85de3-50c5-4ee7-8fc6-b6602aee1538 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1722 microversion: 2.20 time: 0.512040 Aug 31 04:10:44.666574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 274/551] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:44 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:10:44.969766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:44.984841 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1165dbb1-237f-4f58-a3c0-b3fc39ead794 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1752 microversion: 2.1 time: 0.560855 Aug 31 04:10:44.985744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 278/552] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:44 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1752 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:45.047779 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:45.048417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:45.059596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:45.060332 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:45.060957 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:45.061667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:45.062117 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:45.062542 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:45.084493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 HTTP/1.1 Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:10:45.093353 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:10:45.095098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': 'fdae6298-1a2e-4f4a-88e0-32a21a1fed41'} Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:10:45.095986 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:10:45.097319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:45.100839 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:10:45.112508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3d3b2670-b3a1-4581-b71c-ffdcf2bd29f7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 404 len: 111 microversion: 2.1 time: 0.068728 Aug 31 04:10:45.113785 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 275/553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:45 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:10:45.122260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fd732526-cbcb-460b-9537-2fe7dedca2b3 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '.version_select at 0x7f88ad2ee700>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:45.200151 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fd732526-cbcb-460b-9537-2fe7dedca2b3 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675423434" status: 202 len: 0 microversion: 2.1 time: 0.081618 Aug 31 04:10:45.206953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 279/554] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 31 04:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675423434 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:10:45.296100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-2dfd4fb8-1cd5-46d3-9e15-8e641c9528c0 req-22e98bc3-0f07-4ad4-9083-09c0fe38a390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675abe1e-ac1e-458b-b5ac-745a7f6917b7", "name": "network-vif-deleted", "tag": "4a38be32-98cb-48fd-b704-e08ed42a7fef"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:45.319389 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-2dfd4fb8-1cd5-46d3-9e15-8e641c9528c0 req-22e98bc3-0f07-4ad4-9083-09c0fe38a390 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:45.319708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-2dfd4fb8-1cd5-46d3-9e15-8e641c9528c0 req-22e98bc3-0f07-4ad4-9083-09c0fe38a390 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:45.320139 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-2dfd4fb8-1cd5-46d3-9e15-8e641c9528c0 req-22e98bc3-0f07-4ad4-9083-09c0fe38a390 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:45.367538 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-2dfd4fb8-1cd5-46d3-9e15-8e641c9528c0 req-22e98bc3-0f07-4ad4-9083-09c0fe38a390 service nova] Creating event network-vif-deleted:4a38be32-98cb-48fd-b704-e08ed42a7fef for instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 on hv-cinder-85391 Aug 31 04:10:45.383285 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-2dfd4fb8-1cd5-46d3-9e15-8e641c9528c0 req-22e98bc3-0f07-4ad4-9083-09c0fe38a390 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091411 Aug 31 04:10:45.384489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 276/555] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:45.689799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:45.690549 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:45.705002 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:45.713470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:45.715777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:45.717049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:45.718948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:45.719498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:45.817432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:45.817936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:45.818368 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:45.818821 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lazy-loading 'fault' on Instance uuid 675abe1e-ac1e-458b-b5ac-745a7f6917b7 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:10:45.952604 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:45.969581 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:45.970985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:45.972205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9d899bf4-bfeb-4e81-8222-5d16ecc35249 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 200 len: 1371 microversion: 2.20 time: 0.286366 Aug 31 04:10:45.976205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 280/556] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:45 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:10:46.006852 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:46.008256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:46.021280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:46.022005 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:46.022592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:46.027779 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:46.028564 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:46.029162 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:46.368755 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:46.388265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-52a75947-d297-4b65-9d6e-0a93ff63bc6f tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1752 microversion: 2.1 time: 0.381744 Aug 31 04:10:46.390618 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 277/557] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:46 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1752 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:47.005454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:47.006072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:47.014519 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:47.016001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:47.020009 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:47.021959 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:47.022663 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:47.023313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:47.031600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:47.032090 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:47.039961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:47.040486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:47.040916 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:47.042053 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:47.042544 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:47.043009 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:47.050176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] HTTP exception thrown: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Request method failure captured: Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 HTTP/1.1 Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5Eg6KYMxJKbjLzrbyTkF9vp9WlR6XPV_ugaUyY2uP-JiDy-FrTE_lg-OwfDmpoEs9s2H0HUmvxgsxHjVVF2GjRcgJZEzO29MtEQ7yWhYwnn5LFGtSk6g4mQE0jz-9G4NHtpsSkInh8xGuJqc7WVxCnlY2ctNeukZY7xyuFgww1nbc Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:10:47.055186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66bcbde4eda6417ea15dca2371c28540", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 956b08da3ba944d382877cf266389127 Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:10:47.056815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '675abe1e-ac1e-458b-b5ac-745a7f6917b7'} Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:10:47.057556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:10:47.058730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:10:47.060301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Returning 404 to user: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:10:47.060301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3309834d-ce26-4227-9adb-78edeb4b7f5f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 404 len: 111 microversion: 2.20 time: 0.055945 Aug 31 04:10:47.060301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 281/558] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:46 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:10:47.071227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2b331950-35f4-4dcd-878c-776be855cc48 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '.version_select at 0x7f88ad412dc0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:47.104340 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2b331950-35f4-4dcd-878c-776be855cc48 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123751580" status: 204 len: 0 microversion: 2.20 time: 0.040053 Aug 31 04:10:47.108759 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 282/559] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Aug 31 04:10:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123751580 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 04:10:47.146697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lazy-loading 'services' on Instance uuid 8e5504b0-52b4-4d1a-a67b-6d6e26053371 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:10:47.236960 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-87841c01-c638-42ad-bd1e-33a73244e1a8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments/5f21c0be-ccd3-4987-b1c3-2afc36a97662" status: 202 len: 0 microversion: 2.1 time: 0.209613 Aug 31 04:10:47.241861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 278/560] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:10:47 2022] DELETE /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments/5f21c0be-ccd3-4987-b1c3-2afc36a97662 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 04:10:47.257026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:47.269042 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:47.290745 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:47.296991 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:47.297920 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:47.298792 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:47.301321 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:47.306131 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:47.315331 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:47.380435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-409b4ed8-f31e-41b3-bfab-d6d945e7700f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137614 Aug 31 04:10:47.382191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 283/561] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:10:47 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:47.412968 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:47.414605 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:47.423726 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:47.427996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:47.428639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:47.429651 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:47.430282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:47.431232 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:47.760743 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:47.769640 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-eaece541-de55-438d-b1de-0c3b58cb01bc tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1757 microversion: 2.1 time: 0.361877 Aug 31 04:10:47.785105 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 279/562] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:47 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1757 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:48.393608 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:48.395835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:48.406507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:48.407495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:48.412782 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:48.413524 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:48.414161 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:48.414816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:48.449220 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a15d07e9-c14c-429f-bbaa-2b7949392cb8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'create', calling method: .version_select at 0x7f88ad1e25e0>, body: {"keypair": {"name": "tempest-keypair-302895557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh2wosKLG4INOsyNwx5Jw6jeYB6fhDhK1cjdY48Z6Qf3/jCVNDk5DEVdyUThrnNWDs1lfeuhOVD4wD/tL22J9IsZdqAu3Inle+SBZqARsFgTW+I1Gx+Siu2lH4paBNeA=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:48.463638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-70f07771-ba83-4d93-abac-7dbbf07092c1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074447 Aug 31 04:10:48.464289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 284/563] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:10:48 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:48.466679 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-a15d07e9-c14c-429f-bbaa-2b7949392cb8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Getting quotas for project 66bcbde4eda6417ea15dca2371c28540. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:10:48.473030 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-a15d07e9-c14c-429f-bbaa-2b7949392cb8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Getting quotas for user 956b08da3ba944d382877cf266389127 and project 66bcbde4eda6417ea15dca2371c28540. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:10:48.503067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a15d07e9-c14c-429f-bbaa-2b7949392cb8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.058737 Aug 31 04:10:48.503898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 280/564] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Aug 31 04:10:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 31 04:10:48.791686 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:48.792294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:48.800501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:48.800996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:48.801505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:48.802223 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:48.802674 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:48.803191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:48.996840 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:49.008340 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b63afa63-4b2d-490e-acef-d719188bda29 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1757 microversion: 2.1 time: 0.220428 Aug 31 04:10:49.008937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 285/565] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:48 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:49.476552 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:49.487641 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:49.514196 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:49.514789 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:49.516075 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:49.518142 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:49.518616 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:49.519082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:49.524199 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:49.556961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-76b3113b-bbd1-464c-8183-c0ef478301d6 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084801 Aug 31 04:10:49.557870 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 281/566] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:10:49 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:50.031152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:50.031908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:50.048495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:50.049197 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:50.049685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:50.050582 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:50.051183 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:50.052527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:50.518807 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:50.527474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f36c745d-12f3-4fe8-ac50-1afbc837fa39 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1757 microversion: 2.1 time: 0.501871 Aug 31 04:10:50.534717 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 286/567] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:50 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1757 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:50.572861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:50.576401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:50.587420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:50.589124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:50.589730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:50.591588 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:50.592521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:50.593395 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:50.637366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-261fe945-d903-47c3-b440-ee03cd9167f2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070990 Aug 31 04:10:50.642845 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 282/568] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:10:50 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:51.057752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1829661504", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52829969-a42a-442d-a4b2-1b1707d47a14"}], "security_groups": [{"name": "tempest-securitygroup--959416947"}], "key_name": "tempest-keypair-302895557", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:51.208965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:51.217134 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:51.251345 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:51.252144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:51.252784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:51.253847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:51.254705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:51.255289 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:51.302929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lazy-loading 'flavor' on Instance uuid cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:10:51.333530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] validate_networks() for [('52829969-a42a-442d-a4b2-1b1707d47a14', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:10:51.565677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-11e04205-6543-4643-abfe-3f85ee6e1c48 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/action" status: 200 len: 32 microversion: 2.1 time: 0.361912 Aug 31 04:10:51.567216 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 283/569] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:10:51 2022] POST /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 04:10:51.572831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:51.578144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:51.597682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:51.599697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:51.605731 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:51.607239 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:51.608665 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:51.609358 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:52.420966 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:52.444757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c2f211f4-c434-42cd-9ff5-319092087b02 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1757 microversion: 2.1 time: 0.875184 Aug 31 04:10:52.445658 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 284/570] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:51 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1757 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:52.452788 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:52.453737 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:52.461889 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:52.462780 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:52.463463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:52.464395 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:52.465077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:52.465782 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:52.914367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:52.923332 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a7acc371-b807-475a-a929-9efab8c509b1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.476152 Aug 31 04:10:52.924022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 285/571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:52 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:52.928669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:52.930970 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:52.937391 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:52.937878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:52.938311 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:52.939057 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:52.939527 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:52.939947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:52.969643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-2c909543-5f78-44f3-b7b9-94ad5fdd4b67 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044412 Aug 31 04:10:52.970339 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 286/572] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:10:52 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:10:52.972438 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:10:52.972967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:10:52.973574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:10:52.974066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:10:52.974565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:10:52.991972 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:52.992805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:52.993492 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:52.994334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:52.994858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:52.995363 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:53.014374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Getting quotas for project 66bcbde4eda6417ea15dca2371c28540. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:10:53.019229 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Getting quotas for user 956b08da3ba944d382877cf266389127 and project 66bcbde4eda6417ea15dca2371c28540. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:10:53.032333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:10:53.034804 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:10:53.035599 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:53.036076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:53.042191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:53.042679 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:53.043135 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:53.043859 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:53.044315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:53.044733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:53.070635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:10:53.089182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ccee6f96-f56c-4e75-9acc-0d5f6e28f9a0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.035933 Aug 31 04:10:53.095202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 287/573] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Aug 31 04:10:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 04:10:53.101903 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5c2a06c0-c576-442c-bf5d-a320f75bb079 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:53.102907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5c2a06c0-c576-442c-bf5d-a320f75bb079 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:53.169827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5ce4539b-a967-48ec-bd60-8748e4a2207b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 204 len: 0 microversion: 2.1 time: 0.137542 Aug 31 04:10:53.171080 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 287/574] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:10:53 2022] DELETE /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:10:53.180554 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:53.181248 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:53.186874 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5c2a06c0-c576-442c-bf5d-a320f75bb079 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:53.189194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:53.189733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:53.190345 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:53.191810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:53.192453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:53.193074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:53.197309 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5c2a06c0-c576-442c-bf5d-a320f75bb079 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:53.200899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5c2a06c0-c576-442c-bf5d-a320f75bb079 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:53.203434 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5c2a06c0-c576-442c-bf5d-a320f75bb079 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1281 microversion: 2.20 time: 0.105935 Aug 31 04:10:53.205258 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 288/575] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:53 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:10:53.441759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:53.453392 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c738ead6-30f6-418a-8705-15b275e7160b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1681 microversion: 2.1 time: 0.277363 Aug 31 04:10:53.454030 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 288/576] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:53 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1681 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:10:53.465884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:53.466800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:53.477217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:53.478190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:53.479239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:53.480482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:53.481071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:53.482238 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:53.767062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:53.776270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3d6a8412-5c06-440d-b8b7-b64649760762 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1757 microversion: 2.1 time: 0.314361 Aug 31 04:10:53.776865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 289/577] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:53 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1757 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:53.946624 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:53.947261 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:53.954352 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:53.954800 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:53.955349 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:53.956048 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:53.956504 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:53.956914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:54.226180 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:54.226820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:54.234740 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:54.235507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:54.235883 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:54.236618 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:54.237067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:54.237482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:54.351672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:54.362236 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:54.364797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:54.367781 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-89042ec2-de65-4247-9390-6f69998f39da tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1285 microversion: 2.20 time: 0.144815 Aug 31 04:10:54.368957 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 290/578] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:54 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:10:54.481434 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:54.484822 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:54.497746 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:54.498808 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:54.499918 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:54.501968 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:54.502551 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:54.503129 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:54.540487 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:54.551379 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f52be032-a3b6-4a95-a215-b21e9440fe7a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.610101 Aug 31 04:10:54.565144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 289/579] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:53 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:54.800580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:54.800784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:54.801642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:54.809800 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:54.810696 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:54.811590 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:54.811712 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3dd373bc-3dd4-488b-be79-1b1dbc2c8588 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1681 microversion: 2.1 time: 0.334357 Aug 31 04:10:54.812651 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 291/580] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:54 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:54.817097 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:54.818170 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:54.818844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:55.163644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:55.173229 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3a34a664-ecb5-46c9-9355-5c36d3a4d5c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1757 microversion: 2.1 time: 0.379021 Aug 31 04:10:55.173791 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 290/581] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:54 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1757 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:10:55.394015 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:55.394641 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:55.403334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:55.404914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:55.405591 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:55.406575 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:55.407351 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:55.408006 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:55.533742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:55.550718 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:55.552544 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:55.555426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-798c4c19-21a3-46ff-bcf1-b5372e147dac tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1333 microversion: 2.20 time: 0.166547 Aug 31 04:10:55.559337 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 292/582] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:55 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1333 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:10:55.575769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:55.576320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:55.597779 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:55.598600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:55.599287 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:55.600265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:55.600998 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:55.601577 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:55.833486 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:55.834036 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:55.840365 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:55.841188 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:55.841818 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:55.842561 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:55.843012 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:55.843454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:56.078516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:56.087153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ecc5f47b-88a4-464e-aef3-2fea59029bc8 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.515322 Aug 31 04:10:56.099243 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 291/583] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:55 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:56.194152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:56.194904 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:56.201538 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:56.202024 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:56.202459 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:56.203170 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:56.203845 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:56.204528 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:56.327859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:56.335727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca68d758-3557-4ccb-b639-c45bcd6332e5 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1681 microversion: 2.1 time: 0.506202 Aug 31 04:10:56.336271 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 293/584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:55 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1681 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:56.582344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:56.582942 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:56.589991 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:56.591867 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:56.592840 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:56.593611 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:56.594038 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:56.594664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:56.653622 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:56.667046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1ef3ea0b-9ec0-44bc-92d5-82a48d9a4fa7 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1757 microversion: 2.1 time: 0.476826 Aug 31 04:10:56.667774 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 292/585] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:56 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1757 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:57.025420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:57.034263 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:57.035737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:57.036860 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-67955723-9c8e-4d64-af7c-e52491be2313 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1339 microversion: 2.20 time: 0.458675 Aug 31 04:10:57.037408 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 294/586] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:56 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1339 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:10:57.108290 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:57.108911 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:57.116676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:57.117234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:57.117917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:57.118623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:57.119104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:57.119518 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:57.357786 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:57.358676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:57.370249 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:57.370810 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:57.371526 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:57.372508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:57.372970 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:57.379206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:57.508642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:57.527204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bded6069-dc1e-40d4-b946-07c542e29a79 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.422880 Aug 31 04:10:57.540911 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 293/587] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:57 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:57.561269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:57.574885 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0466f17d-6b0f-44a2-90a9-4db6261d3cc7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 200 len: 1614 microversion: 2.1 time: 0.221141 Aug 31 04:10:57.588751 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 295/588] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:57 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 1614 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:10:57.690068 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:57.690672 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:57.702903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:57.708211 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:57.708668 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:57.709385 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:57.713083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:57.713522 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:57.725247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:57.756883 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a4f96f71-4b8d-4f97-bda6-948d180f9886 req-5df54743-f4b2-472d-8d91-9333c4f4149e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5504b0-52b4-4d1a-a67b-6d6e26053371", "name": "network-vif-deleted", "tag": "55988fa5-eb1f-435f-ba39-34e32cd7d071"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:57.776803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a4f96f71-4b8d-4f97-bda6-948d180f9886 req-5df54743-f4b2-472d-8d91-9333c4f4149e service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:57.777750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a4f96f71-4b8d-4f97-bda6-948d180f9886 req-5df54743-f4b2-472d-8d91-9333c4f4149e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:57.778434 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a4f96f71-4b8d-4f97-bda6-948d180f9886 req-5df54743-f4b2-472d-8d91-9333c4f4149e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:57.797385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a4f96f71-4b8d-4f97-bda6-948d180f9886 req-5df54743-f4b2-472d-8d91-9333c4f4149e service nova] Creating event network-vif-deleted:55988fa5-eb1f-435f-ba39-34e32cd7d071 for instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 on hv-cinder-85391 Aug 31 04:10:57.804384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a4f96f71-4b8d-4f97-bda6-948d180f9886 req-5df54743-f4b2-472d-8d91-9333c4f4149e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050931 Aug 31 04:10:57.805385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 296/589] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:58.062218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:58.062910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:58.072972 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:58.073452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:58.073879 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:58.074651 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:58.076605 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:58.078690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:58.113275 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:58.123985 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-2a245a49-70c4-498e-9765-491631203fc2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1760 microversion: 2.1 time: 0.439327 Aug 31 04:10:58.124568 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 294/590] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:57 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1760 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:58.357491 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:58.369111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:58.373835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:58.376745 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1e63e0d9-0c41-4266-88e3-5bd4dd1ed437 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1406 microversion: 2.20 time: 0.319129 Aug 31 04:10:58.377497 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 297/591] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:58 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:10:58.483956 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=4 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:58.549398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:58.550319 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:58.560028 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:58.561487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:58.562810 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:58.565644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:58.566289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:58.567531 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:58.749246 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-069ed42d-fccf-43d4-b0d8-75272fb0f00d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Action: 'create', calling method: .version_select at 0x7f88ad2eb5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1423806456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApvsd7MMzCxTfpyI0PVwqQHyWckeMTL88BmUCDeS8ENN3G7zJUKQlRv54u8+dzL9ud5dw7FkuFPiqVl4lcT3gFa2XNVSKhsgcPGBzwVN0aJyfdwgatj0GXxjZ5xw8HvFQ=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:58.766980 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-069ed42d-fccf-43d4-b0d8-75272fb0f00d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Getting quotas for project e6db5b66c75c499d98d02d6e0041299f. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:10:58.772411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-069ed42d-fccf-43d4-b0d8-75272fb0f00d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Getting quotas for user 62f5d4659eea4d91a689d709460396d2 and project e6db5b66c75c499d98d02d6e0041299f. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:10:58.802381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-069ed42d-fccf-43d4-b0d8-75272fb0f00d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.396636 Aug 31 04:10:58.803326 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 295/592] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:10:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:58.808790 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:58.811960 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:58.818108 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:58.818587 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:58.819008 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:58.819717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:58.820158 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:58.820750 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:58.837827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 HTTP/1.1 Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:10:58.840058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:10:58.841603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '8e5504b0-52b4-4d1a-a67b-6d6e26053371'} Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:10:58.842366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:10:58.843784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:10:58.848766 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:10:58.849833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5b6976eb-faab-4097-9b16-57e4679cabdd tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 404 len: 111 microversion: 2.1 time: 0.045454 Aug 31 04:10:58.850893 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 296/593] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:58 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:10:58.861611 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5af1c3f0-3221-4eb8-b2fa-fe9be89dc403 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '.version_select at 0x7f88ad433160>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:58.893668 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5af1c3f0-3221-4eb8-b2fa-fe9be89dc403 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054636436" status: 202 len: 0 microversion: 2.1 time: 0.037693 Aug 31 04:10:58.895014 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 297/594] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 31 04:10:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054636436 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:10:58.930983 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:58.940282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e8d8e0cb-468a-4204-8531-6b91da52289d tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.395203 Aug 31 04:10:58.941496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 298/595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:58 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:10:59.412969 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:59.413620 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:59.420304 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:59.422378 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:59.423185 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:59.423983 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:59.425032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:59.425709 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:59.426355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:59.662168 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:59.674635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:59.680573 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:10:59.685863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-11e66d34-f2a7-4445-998e-ba1ae2a1c21d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1406 microversion: 2.20 time: 0.277600 Aug 31 04:10:59.686912 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 298/596] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:10:59 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:10:59.852049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-43be3617-8aa5-46f7-b7a9-f304392b2df0 req-c4bb283a-15a2-40cc-bb7d-e5f4327aff0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b117348-7be9-4bab-800d-3bb55db4f771", "tag": "9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:59.866865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-43be3617-8aa5-46f7-b7a9-f304392b2df0 req-c4bb283a-15a2-40cc-bb7d-e5f4327aff0a service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:59.867525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-43be3617-8aa5-46f7-b7a9-f304392b2df0 req-c4bb283a-15a2-40cc-bb7d-e5f4327aff0a service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:59.867776 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4005e674-6768-4b62-9ca3-432ecc015d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: .version_select at 0x7f88ad2ebaf0>, body: {"keypair": {"name": "tempest-keypair-680554599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmBc+p8ukqGKsD+LPK5Xlo/K45fUuWpAtQ7lSWiMctqT1w89+7i55g8OlYWwyG/+zdX/pmfjP63HNNf4ehC83s0FwNyk+Cxl1svmGEVH5GHSNRiBe9IwjE6WpF7twlqRQ=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:10:59.868243 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-43be3617-8aa5-46f7-b7a9-f304392b2df0 req-c4bb283a-15a2-40cc-bb7d-e5f4327aff0a service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:59.881696 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-43be3617-8aa5-46f7-b7a9-f304392b2df0 req-c4bb283a-15a2-40cc-bb7d-e5f4327aff0a service nova] Creating event network-changed:9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1 for instance 0b117348-7be9-4bab-800d-3bb55db4f771 on hv-cinder-85391 Aug 31 04:10:59.887099 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-43be3617-8aa5-46f7-b7a9-f304392b2df0 req-c4bb283a-15a2-40cc-bb7d-e5f4327aff0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038688 Aug 31 04:10:59.888071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 299/597] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:10:59.898851 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-4005e674-6768-4b62-9ca3-432ecc015d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:10:59.905236 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-4005e674-6768-4b62-9ca3-432ecc015d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for user f80c8c1d6af7450eb8f936df231ad63b and project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:10:59.937059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4005e674-6768-4b62-9ca3-432ecc015d48 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073710 Aug 31 04:10:59.938232 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 299/598] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:10:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:10:59.967974 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:10:59.969260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:10:59.976144 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:59.981191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:59.982063 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:59.982694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:10:59.983781 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:10:59.984397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:10:59.986123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:00.157661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:00.170992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8f6c299e-538a-4d61-b2e1-a77f7ace7332 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.210256 Aug 31 04:11:00.171650 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 300/599] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:10:59 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:11:00.710635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:00.711549 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:00.722073 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:00.722801 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:00.723492 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:00.724672 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:00.725364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:00.726407 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:01.081411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:01.093998 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:01.096454 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:01.097808 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-80ecb2ad-5319-4527-9270-c4664c8e9b34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1406 microversion: 2.20 time: 0.392860 Aug 31 04:11:01.098393 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 300/600] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:00 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:11:01.198342 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:01.199879 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:01.208769 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:01.209632 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:01.210452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:01.211577 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:01.212250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:01.212889 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:01.938213 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:01.957206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f2e540d5-a9a7-4ece-9bf3-769fb33b6745 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.766812 Aug 31 04:11:01.967333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 301/601] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:01 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:02.121095 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:02.121842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:02.128976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:02.129692 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:02.130367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:02.131744 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:02.132286 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:02.132967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:02.350513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:02.359394 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:02.361292 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:02.362480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1837dfff-27db-4a26-98ce-98826da7925f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1406 microversion: 2.20 time: 0.245520 Aug 31 04:11:02.363424 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 301/602] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:02 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:11:02.703273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1383267521", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df2a7da3-c61f-4600-a4d7-00eeb18098d5"}], "security_groups": [{"name": "tempest-securitygroup--888744685"}], "key_name": "tempest-keypair-680554599", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:02.813661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] validate_networks() for [('df2a7da3-c61f-4600-a4d7-00eeb18098d5', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:11:02.979123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:02.979913 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:02.986787 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:02.987380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:02.987815 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:02.988505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:02.988940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:02.989390 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:03.003538 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:03.192797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=8 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:03.236917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:03.247066 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-804485df-84ab-45f7-8a1e-4926317d47df tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.271617 Aug 31 04:11:03.260963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 302/603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:02 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:03.290309 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:11:03.290794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:11:03.291328 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:11:03.291731 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:11:03.292137 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:11:03.301832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:03.302404 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:03.302916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:03.303751 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:03.304274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:03.304763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:03.323900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:11:03.328255 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for user f80c8c1d6af7450eb8f936df231ad63b and project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:11:03.340927 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:11:03.343293 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:11:03.388944 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:03.389786 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:03.396272 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:03.396949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6db84632-af98-41c9-8aa2-09ba46f46793 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698383 Aug 31 04:11:03.397098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:03.397382 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:03.403729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 302/604] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:11:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:11:03.403887 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:03.403887 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:03.403887 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:03.410362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c4ef4b0c-3176-4367-a916-fd22df602804 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:03.410976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c4ef4b0c-3176-4367-a916-fd22df602804 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:03.549845 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c4ef4b0c-3176-4367-a916-fd22df602804 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:03.559085 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c4ef4b0c-3176-4367-a916-fd22df602804 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1241 microversion: 2.1 time: 0.152662 Aug 31 04:11:03.563076 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 303/605] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:03 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:03.605755 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:03.614855 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:03.620259 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:03.621433 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-67c1f681-e83d-4ce2-ae3a-2ccd8263550f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1406 microversion: 2.20 time: 0.237016 Aug 31 04:11:03.622350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 303/606] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:03 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:11:03.776345 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f35b8d7b-da7b-47fd-9943-ec13dd5eec02 req-1c4662ae-79a4-428b-958e-810d0310ca80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b117348-7be9-4bab-800d-3bb55db4f771", "name": "network-vif-plugged", "status": "completed", "tag": "9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:03.787097 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f35b8d7b-da7b-47fd-9943-ec13dd5eec02 req-1c4662ae-79a4-428b-958e-810d0310ca80 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:03.787803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f35b8d7b-da7b-47fd-9943-ec13dd5eec02 req-1c4662ae-79a4-428b-958e-810d0310ca80 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:03.788225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f35b8d7b-da7b-47fd-9943-ec13dd5eec02 req-1c4662ae-79a4-428b-958e-810d0310ca80 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:03.800909 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f35b8d7b-da7b-47fd-9943-ec13dd5eec02 req-1c4662ae-79a4-428b-958e-810d0310ca80 service nova] Creating event network-vif-plugged:9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1 for instance 0b117348-7be9-4bab-800d-3bb55db4f771 on hv-cinder-85391 Aug 31 04:11:03.806430 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f35b8d7b-da7b-47fd-9943-ec13dd5eec02 req-1c4662ae-79a4-428b-958e-810d0310ca80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033747 Aug 31 04:11:03.807214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 304/607] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:04.269372 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:04.270847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:04.277832 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:04.278811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:04.279390 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:04.280094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:04.280571 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:04.280996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:04.421286 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:04.430532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4fad39b2-e83e-4223-adca-96f7a6844a18 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.165262 Aug 31 04:11:04.431158 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 304/608] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:04 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:04.581542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:04.582150 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:04.589527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:04.590065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:04.590574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:04.591292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:04.591751 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:04.592254 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:04.596921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:04.644347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:04.644963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:04.651078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:04.651597 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:04.652107 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:04.652811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:04.653290 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:04.654028 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:04.663953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:04.671969 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9e4962bc-6429-4b32-b6e7-9b33853fc584 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1293 microversion: 2.1 time: 0.095656 Aug 31 04:11:04.672548 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 305/609] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:04 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:04.791821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:04.801240 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:04.802687 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:04.803847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-498e064a-8fe4-4bd4-b8c2-8d92e259c95a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1406 microversion: 2.20 time: 0.163494 Aug 31 04:11:04.804380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 305/610] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:04 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:11:05.453027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:05.453642 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:05.461071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:05.461549 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:05.461986 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:05.462673 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:05.463145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:05.463560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:05.608718 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:05.617837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0484542f-d606-4139-9197-0130b5d57f8a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.168809 Aug 31 04:11:05.618905 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 306/611] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:05 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:05.693702 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:05.695049 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:05.702459 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:05.702950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:05.703437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:05.704122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:05.704575 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:05.704992 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:05.776592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:05.785204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-2681a209-721b-4461-89b9-f517d5774d81 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1301 microversion: 2.1 time: 0.095326 Aug 31 04:11:05.785783 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 306/612] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:05 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:05.827938 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:05.828466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:05.835965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:05.836515 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:05.836967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:05.837695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:05.838197 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:05.838611 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:06.079529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:06.087952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:06.089386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:06.090634 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9d4abd77-f30a-49d2-b1bb-0415ed380b04 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1599 microversion: 2.20 time: 0.267623 Aug 31 04:11:06.091222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 307/613] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:05 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1599 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:11:06.114315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:06.114831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:06.121435 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:06.121972 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:06.122481 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:06.123373 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:06.123834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:06.124256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:06.253202 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7f3e7ad8-98a3-4fe6-933b-98900307f483 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.143291 Aug 31 04:11:06.253784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 307/614] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Aug 31 04:11:06 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:11:06.642950 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:06.643628 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:06.650343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:06.651277 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:06.652518 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:06.654407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:06.655688 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:06.656279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:06.807178 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:06.807972 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:06.815382 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:06.816280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:06.817279 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:06.818312 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:06.818997 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:06.819645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:06.983288 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:06.996381 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-eccc463b-9569-4654-a0d3-14b9264568aa tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.359763 Aug 31 04:11:06.997383 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 308/615] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:06 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:11:07.133863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:07.154136 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6e777ae8-61f3-493c-9309-b8c307da1ea4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1366 microversion: 2.1 time: 0.351272 Aug 31 04:11:07.161003 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 308/616] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:06 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:07.407554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f4c7514c-bf2d-4585-92ac-685740fcb435 req-bf27e729-5d41-4d25-9afa-25a5c52c580d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b117348-7be9-4bab-800d-3bb55db4f771", "tag": "9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:07.420101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f4c7514c-bf2d-4585-92ac-685740fcb435 req-bf27e729-5d41-4d25-9afa-25a5c52c580d service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:07.420579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f4c7514c-bf2d-4585-92ac-685740fcb435 req-bf27e729-5d41-4d25-9afa-25a5c52c580d service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:07.421001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f4c7514c-bf2d-4585-92ac-685740fcb435 req-bf27e729-5d41-4d25-9afa-25a5c52c580d service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:07.445641 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f4c7514c-bf2d-4585-92ac-685740fcb435 req-bf27e729-5d41-4d25-9afa-25a5c52c580d service nova] Creating event network-changed:9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1 for instance 0b117348-7be9-4bab-800d-3bb55db4f771 on hv-cinder-85391 Aug 31 04:11:07.451201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f4c7514c-bf2d-4585-92ac-685740fcb435 req-bf27e729-5d41-4d25-9afa-25a5c52c580d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047490 Aug 31 04:11:07.452211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 309/617] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:08.025263 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:08.026817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:08.034006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:08.034961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:08.035566 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:08.036381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:08.036936 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:08.037462 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:08.077500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-df917a2c-1ec5-4dc1-afae-bc1b73048ddd req-a1847a8e-a42d-43c7-a3e4-2720ecef5811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2ce931-07fc-460a-a503-f4cf14e7529f", "tag": "28968224-df03-434c-92f2-71bec01daf3d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:08.088183 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-df917a2c-1ec5-4dc1-afae-bc1b73048ddd req-a1847a8e-a42d-43c7-a3e4-2720ecef5811 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:08.088642 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-df917a2c-1ec5-4dc1-afae-bc1b73048ddd req-a1847a8e-a42d-43c7-a3e4-2720ecef5811 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:08.089253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-df917a2c-1ec5-4dc1-afae-bc1b73048ddd req-a1847a8e-a42d-43c7-a3e4-2720ecef5811 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:08.102368 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-df917a2c-1ec5-4dc1-afae-bc1b73048ddd req-a1847a8e-a42d-43c7-a3e4-2720ecef5811 service nova] Creating event network-changed:28968224-df03-434c-92f2-71bec01daf3d for instance 2a2ce931-07fc-460a-a503-f4cf14e7529f on hv-cinder-85391 Aug 31 04:11:08.112832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-df917a2c-1ec5-4dc1-afae-bc1b73048ddd req-a1847a8e-a42d-43c7-a3e4-2720ecef5811 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044234 Aug 31 04:11:08.113457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 310/618] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:11:08.182734 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:08.183737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:08.190969 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:08.191498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:08.191933 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:08.192641 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:08.193279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:08.193817 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:08.779980 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:08.788553 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d72fe608-a7de-41e9-8a32-70cd808c935e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.767692 Aug 31 04:11:08.789148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 309/619] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:08 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:08.888874 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:08.899668 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9d97ad14-fcc0-4090-a4cb-b2358539333c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1366 microversion: 2.1 time: 0.721240 Aug 31 04:11:08.900247 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 311/620] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:08 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:11:09.810102 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:09.810675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:09.817896 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:09.818376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:09.818801 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:09.819528 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:09.819968 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:09.820378 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:09.919954 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=8 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:09.924221 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:09.924922 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:09.931385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:09.931872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:09.932484 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:09.933302 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:09.933746 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:09.934157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:09.964507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:09.973699 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a84fe7cd-026b-4db5-af7c-573595061921 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.167593 Aug 31 04:11:09.974376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 310/621] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:09 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:10.076884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:10.085181 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3b064812-dd45-4347-8fa8-1e8fba1e121e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1366 microversion: 2.1 time: 0.166855 Aug 31 04:11:10.085942 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 312/622] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:09 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:10.998561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:10.999403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:11.006385 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:11.006855 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:11.007528 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:11.008225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:11.008674 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:11.009093 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:11.105915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:11.106510 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:11.113923 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:11.114412 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:11.114841 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:11.115572 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:11.116018 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:11.116432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:11.144863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:11.158148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-24541efa-d552-4ac8-8d1a-6f044f32f78e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.164633 Aug 31 04:11:11.159215 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 311/623] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:10 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:11.376795 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:11.385495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c98bd586-9d06-4295-bf5d-12ee657b7817 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1366 microversion: 2.1 time: 0.283540 Aug 31 04:11:11.386207 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 313/624] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:11 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:12.180447 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:12.181019 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:12.188749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:12.188749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:12.189277 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:12.190027 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:12.190384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:12.190906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:12.323051 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:12.331904 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f0ab6a4b-21d5-403e-a5db-4237a34405c9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1734 microversion: 2.1 time: 0.155831 Aug 31 04:11:12.332484 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 312/625] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:12 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:12.409606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:12.410164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:12.417026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:12.417520 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:12.417943 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:12.418629 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:12.419121 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:12.419546 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:12.560826 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:12.569028 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9fc33438-6435-45c6-a988-f26dfa29579b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1366 microversion: 2.1 time: 0.164688 Aug 31 04:11:12.569602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 314/626] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:12 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:13.355160 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:13.355837 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:13.363851 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.364338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.364772 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.365461 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.365916 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.366340 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.498473 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:13.507167 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0d316ee3-2973-41da-b9e2-b06ed3c6b2d5 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1714 microversion: 2.1 time: 0.157074 Aug 31 04:11:13.507738 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 313/627] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:13 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:13.590118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:13.591948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:13.594750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:13.596515 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=8 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:13.604543 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.605294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.605947 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.606612 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.607264 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.607838 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.640108 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:13.640917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:13.647942 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.648472 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.648877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.649843 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.650378 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.650855 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.752652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:13.757349 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] HTTP exception thrown: Cannot 'detach_volume' instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 while it is in vm_state rescued Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Request method failure captured: Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: DELETE /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments/2cb355a8-737a-4688-a754-51ba56f2178e HTTP/1.1 Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LN2xm1e7l3XFMnWbmEAaROgQ1gXyS3SqClPo4af2j-ozeboSvhGYasV6hYLHuQvowyA6i4IHjFdIknTIaMgM0CMmswvcO0WF5hoAo9nRPMTue_8211fo0yFb6dVUNAQm55ga87eUbSE5aajuJrQBereu438VnS_rxuCv2jqmIXTQ Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:11:13.759489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_490f695240294bbaa99f5eaa1e32b977", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 77fb76da34bf44a1b214a08bb4b8e51b Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:11:13.761115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Cannot 'detach_volume' instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 while it is in vm_state rescued Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'server_id': 'cfefb434-dbeb-4fcc-8ebd-8603ee9beae9', 'id': '2cb355a8-737a-4688-a754-51ba56f2178e'} Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:11:13.762074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 while it is in vm_state rescued Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 while it is in vm_state rescued Aug 31 04:11:13.763595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:11:13.764776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:13.765527 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Returning 409 to user: Cannot 'detach_volume' instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 while it is in vm_state rescued {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:11:13.766943 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0c7b7a32-7b10-4a6b-b29c-23aab87f70a1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments/2cb355a8-737a-4688-a754-51ba56f2178e" status: 409 len: 152 microversion: 2.1 time: 0.130855 Aug 31 04:11:13.768043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 314/628] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:11:13 2022] DELETE /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments/2cb355a8-737a-4688-a754-51ba56f2178e => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 04:11:13.773443 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-ea4dced2-d5a3-4db0-9c89-069475f8f1c5 req-bb3e7499-e6de-4e02-ba67-d8ebbfd825ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2ce931-07fc-460a-a503-f4cf14e7529f", "name": "network-vif-plugged", "status": "completed", "tag": "28968224-df03-434c-92f2-71bec01daf3d"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:13.776458 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c0e41ccd-37d0-4f4f-9d9d-b8828099a70e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1366 microversion: 2.1 time: 0.190815 Aug 31 04:11:13.777106 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 315/629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:13 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:13.781978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:13.782662 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:13.784978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ea4dced2-d5a3-4db0-9c89-069475f8f1c5 req-bb3e7499-e6de-4e02-ba67-d8ebbfd825ef service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.785457 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ea4dced2-d5a3-4db0-9c89-069475f8f1c5 req-bb3e7499-e6de-4e02-ba67-d8ebbfd825ef service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.785885 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ea4dced2-d5a3-4db0-9c89-069475f8f1c5 req-bb3e7499-e6de-4e02-ba67-d8ebbfd825ef service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.789088 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.789882 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.790482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.791352 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.791827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.792350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.797013 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-ea4dced2-d5a3-4db0-9c89-069475f8f1c5 req-bb3e7499-e6de-4e02-ba67-d8ebbfd825ef service nova] Creating event network-vif-plugged:28968224-df03-434c-92f2-71bec01daf3d for instance 2a2ce931-07fc-460a-a503-f4cf14e7529f on hv-cinder-85391 Aug 31 04:11:13.803453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-ea4dced2-d5a3-4db0-9c89-069475f8f1c5 req-bb3e7499-e6de-4e02-ba67-d8ebbfd825ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034017 Aug 31 04:11:13.804574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 315/630] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:13.872228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7c5f52db-0704-4025-b2ca-013d1a6b9cae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "POST /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/action" status: 202 len: 0 microversion: 2.1 time: 0.093914 Aug 31 04:11:13.873061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 316/631] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:11:13 2022] POST /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:11:13.882121 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:13.884291 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:13.892827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.893316 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.893821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:13.894523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:13.894971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:13.895598 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:14.190026 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:14.198875 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d4695006-a34a-4897-b73a-fc44dfc5af5f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1722 microversion: 2.1 time: 0.320885 Aug 31 04:11:14.199885 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 316/632] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:13 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:14.804808 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:14.805816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:14.815674 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:14.816154 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:14.816578 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:14.817254 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:14.817695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:14.818110 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:14.956432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:14.964428 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0b4a4a1-ec51-45f3-92c5-bd8dbf2fdf0a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1366 microversion: 2.1 time: 0.167650 Aug 31 04:11:14.964999 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 317/633] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:14 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:15.221925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:15.223154 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:15.230049 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:15.230546 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:15.231218 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:15.232145 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:15.232592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:15.233014 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:15.366766 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:15.375404 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ed84f30b-5e69-4a7d-aa4e-e81b967bfeaf tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1722 microversion: 2.1 time: 0.158098 Aug 31 04:11:15.376075 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 317/634] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:15 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:15.988877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:15.989471 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:15.999001 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:15.999878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:16.000511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:16.001466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:16.001937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:16.002351 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:16.242794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:16.250638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6a22175e-02c1-4bac-8ba7-af1bb8c9ae33 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1366 microversion: 2.1 time: 0.268754 Aug 31 04:11:16.251350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 318/635] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:15 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:16.397263 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:16.397867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:16.404478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:16.404947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:16.405377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:16.406063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:16.406512 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:16.406948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:16.441739 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1546924837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1423806456", "security_groups": [{"name": "tempest-secgroup-smoke-1889188028"}], "block_device_mapping_v2": [{"uuid": "2391cbdb-578e-4e09-b0ef-b1f92ed6124b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afdd8bcf-e898-41b9-a268-9083d2b02846"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:16.562866 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:16.571208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-794c3837-5d38-4f58-a45d-353295aadd6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1722 microversion: 2.1 time: 0.177994 Aug 31 04:11:16.571778 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 318/636] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:16 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:16.577876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] validate_networks() for [('afdd8bcf-e898-41b9-a268-9083d2b02846', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:11:16.998912 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:11:16.999565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:11:16.999814 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:11:17.000214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:11:17.000727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:11:17.010068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.010542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.010973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.011716 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.012163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.012584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.030234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Getting quotas for project e6db5b66c75c499d98d02d6e0041299f. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:11:17.034929 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Getting quotas for user 62f5d4659eea4d91a689d709460396d2 and project e6db5b66c75c499d98d02d6e0041299f. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:11:17.096222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:11:17.099754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2391cbdb-578e-4e09-b0ef-b1f92ed6124b',volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:11:17.250757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-93a09292-70e1-4459-b98b-ed98bd901efd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.812982 Aug 31 04:11:17.251411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 319/637] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:11:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:11:17.263254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-93da8357-4437-41e6-ba2f-a05f5e1c8258 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:17.263898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-93da8357-4437-41e6-ba2f-a05f5e1c8258 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:17.274069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:17.274762 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:17.300852 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.301696 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.302350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.303322 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.304176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.304808 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.405142 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-93da8357-4437-41e6-ba2f-a05f5e1c8258 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:17.413114 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-93da8357-4437-41e6-ba2f-a05f5e1c8258 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1095 microversion: 2.1 time: 0.154369 Aug 31 04:11:17.419208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 319/638] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:17 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1095 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:17.482805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:17.495603 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fd30f565-b539-4f92-8be1-8078e63b99df tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1557 microversion: 2.1 time: 0.225031 Aug 31 04:11:17.496413 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 320/639] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:17 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:17.517680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:17.518168 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:17.524675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.525176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.525776 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.526480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.526924 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.527393 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.602682 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:17.603713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:17.610583 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.611559 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.611978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.612696 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.613130 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.613551 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.615945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-01edd0b8-8285-45fd-b29e-0f8efdb646f8 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102380 Aug 31 04:11:17.616724 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 320/640] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 31 04:11:17 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:17.909766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:17.922264 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-57000828-7131-4348-9be1-ddb399ffaee1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1728 microversion: 2.1 time: 0.323233 Aug 31 04:11:17.935894 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 321/641] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:17 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1728 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:17.944017 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:17.944506 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:17.951244 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.951728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.952158 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:17.953044 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:17.953494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:17.953911 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:18.103678 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-13e4c4aa-be94-4bc6-b74d-72280d7b27b2 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163508 Aug 31 04:11:18.104463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 321/642] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 31 04:11:17 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:18.439851 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:18.440518 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:18.447366 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:18.447847 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:18.448291 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:18.448990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:18.449425 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:18.450044 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:18.531904 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:18.536285 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:18.541681 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-90206206-95c7-4979-90f1-4006f32077d3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1193 microversion: 2.1 time: 0.106146 Aug 31 04:11:18.555627 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 322/643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:18 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:19.129189 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-c4be6b1c-efbc-4c2e-9d32-390bd2569659 req-8563003d-e0bc-474d-964b-506ee2c38651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2ce931-07fc-460a-a503-f4cf14e7529f", "tag": "28968224-df03-434c-92f2-71bec01daf3d"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:19.147451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c4be6b1c-efbc-4c2e-9d32-390bd2569659 req-8563003d-e0bc-474d-964b-506ee2c38651 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:19.148809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c4be6b1c-efbc-4c2e-9d32-390bd2569659 req-8563003d-e0bc-474d-964b-506ee2c38651 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:19.149466 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c4be6b1c-efbc-4c2e-9d32-390bd2569659 req-8563003d-e0bc-474d-964b-506ee2c38651 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:19.170099 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-c4be6b1c-efbc-4c2e-9d32-390bd2569659 req-8563003d-e0bc-474d-964b-506ee2c38651 service nova] Creating event network-changed:28968224-df03-434c-92f2-71bec01daf3d for instance 2a2ce931-07fc-460a-a503-f4cf14e7529f on hv-cinder-85391 Aug 31 04:11:19.178033 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-c4be6b1c-efbc-4c2e-9d32-390bd2569659 req-8563003d-e0bc-474d-964b-506ee2c38651 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053152 Aug 31 04:11:19.179623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 322/644] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:19.332270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-7c7ba679-442a-4f88-936c-74ea59d793e0 req-3c77d0a8-eae1-407d-90fb-35b87111b34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfefb434-dbeb-4fcc-8ebd-8603ee9beae9", "tag": "18837e08-59b6-49b1-b900-0ef749916fb5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:19.355271 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c7ba679-442a-4f88-936c-74ea59d793e0 req-3c77d0a8-eae1-407d-90fb-35b87111b34a service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:19.356471 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c7ba679-442a-4f88-936c-74ea59d793e0 req-3c77d0a8-eae1-407d-90fb-35b87111b34a service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:19.359214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c7ba679-442a-4f88-936c-74ea59d793e0 req-3c77d0a8-eae1-407d-90fb-35b87111b34a service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:19.385868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-7c7ba679-442a-4f88-936c-74ea59d793e0 req-3c77d0a8-eae1-407d-90fb-35b87111b34a service nova] Creating event network-changed:18837e08-59b6-49b1-b900-0ef749916fb5 for instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 on hv-cinder-85391 Aug 31 04:11:19.392452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-7c7ba679-442a-4f88-936c-74ea59d793e0 req-3c77d0a8-eae1-407d-90fb-35b87111b34a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063911 Aug 31 04:11:19.393872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 323/645] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:19.563978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:19.564905 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:19.571450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:19.572150 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:19.572731 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:19.573604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:19.574207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:19.574789 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:19.726588 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:19.741005 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-465e9db8-4bbb-411c-a27c-2f3986017a5b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1199 microversion: 2.1 time: 0.181129 Aug 31 04:11:19.744172 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 323/646] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:19 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1199 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:11:20.766634 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:20.767769 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:20.775345 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:20.775910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:20.776340 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:20.777050 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:20.777479 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:20.778081 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:20.988324 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:20.996572 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9a63d962-70ae-4054-ba5c-cce1f43d8f22 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.235595 Aug 31 04:11:20.997147 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 324/647] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:20 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:21.408163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-c14c24db-c13c-4d50-9afe-a6c6a9d0bb58 req-ddcf8fa5-b349-4f1c-8339-15eb486ae566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfefb434-dbeb-4fcc-8ebd-8603ee9beae9", "tag": "18837e08-59b6-49b1-b900-0ef749916fb5"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:21.417879 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c14c24db-c13c-4d50-9afe-a6c6a9d0bb58 req-ddcf8fa5-b349-4f1c-8339-15eb486ae566 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:21.418348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c14c24db-c13c-4d50-9afe-a6c6a9d0bb58 req-ddcf8fa5-b349-4f1c-8339-15eb486ae566 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:21.418768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-c14c24db-c13c-4d50-9afe-a6c6a9d0bb58 req-ddcf8fa5-b349-4f1c-8339-15eb486ae566 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:21.430377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-c14c24db-c13c-4d50-9afe-a6c6a9d0bb58 req-ddcf8fa5-b349-4f1c-8339-15eb486ae566 service nova] Creating event network-changed:18837e08-59b6-49b1-b900-0ef749916fb5 for instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 on hv-cinder-85391 Aug 31 04:11:21.436728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-c14c24db-c13c-4d50-9afe-a6c6a9d0bb58 req-ddcf8fa5-b349-4f1c-8339-15eb486ae566 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031600 Aug 31 04:11:21.437524 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 324/648] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:21.457444 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f4e4c76c-5695-4d34-989f-280721e811c4 req-c559ac82-5b2f-41f6-af12-0a87e12a243e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d85740-5090-4429-a8fb-61391968c231", "tag": "0319ee82-d626-405b-8c17-c745da1ac289"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:21.469144 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f4e4c76c-5695-4d34-989f-280721e811c4 req-c559ac82-5b2f-41f6-af12-0a87e12a243e service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:21.470041 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f4e4c76c-5695-4d34-989f-280721e811c4 req-c559ac82-5b2f-41f6-af12-0a87e12a243e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:21.471759 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f4e4c76c-5695-4d34-989f-280721e811c4 req-c559ac82-5b2f-41f6-af12-0a87e12a243e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:21.486108 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f4e4c76c-5695-4d34-989f-280721e811c4 req-c559ac82-5b2f-41f6-af12-0a87e12a243e service nova] Creating event network-changed:0319ee82-d626-405b-8c17-c745da1ac289 for instance d1d85740-5090-4429-a8fb-61391968c231 on hv-cinder-85391 Aug 31 04:11:21.490896 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f4e4c76c-5695-4d34-989f-280721e811c4 req-c559ac82-5b2f-41f6-af12-0a87e12a243e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038494 Aug 31 04:11:21.491557 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 325/649] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:22.018088 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:22.018669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:22.025459 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:22.025941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:22.026369 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:22.027076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:22.027541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:22.027957 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:22.437410 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:22.445473 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-88f1e0a1-b5c3-4caa-93ec-e80b7993aa48 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.431817 Aug 31 04:11:22.446419 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 325/650] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:22 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:23.471683 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:23.472583 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:23.480685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:23.481281 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:23.481823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:23.482686 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:23.483296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:23.483831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:23.631084 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:23.639627 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f38abd9b-adb6-43a9-bb48-5b84ffa03f21 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.175511 Aug 31 04:11:23.640221 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 326/651] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:23 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:24.664706 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:24.665476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:24.675340 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:24.675825 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:24.676256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:24.676940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:24.677390 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:24.677807 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:24.821010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:24.829824 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-62ee5844-1558-4146-b0e5-b45c27783b2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.171586 Aug 31 04:11:24.830411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 326/652] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:24 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:25.852176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:25.852762 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:25.859498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:25.859979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:25.860472 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:25.861447 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:25.861899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:25.862320 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:26.010941 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:26.022789 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d9da31cd-7d40-44ec-a42e-323b0db5dae2 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.174438 Aug 31 04:11:26.023648 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 327/653] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:25 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:27.051227 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:27.052232 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:27.062590 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:27.063295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:27.063902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:27.064884 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:27.065420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:27.066032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:27.203821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:27.212245 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b44f500a-7388-4c80-a17f-37ff5bb434a3 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.167441 Aug 31 04:11:27.212824 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 327/654] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:27 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:28.233334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:28.233898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:28.236697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:28.237824 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:28.244323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:28.244804 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:28.245223 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:28.245912 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:28.246360 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:28.246780 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:28.392950 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:28.401416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-966f503c-ad83-4926-b3d0-e9900f1aa1f5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.172092 Aug 31 04:11:28.401990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 328/655] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:28 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:29.421496 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:29.422099 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:29.424422 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:29.430221 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:29.430697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:29.431152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:29.431828 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:29.432265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:29.432677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:29.573890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:29.586247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-518a81fe-8e54-4088-aba3-0dac5772578c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.168319 Aug 31 04:11:29.587020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 328/656] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:29 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:30.607339 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:30.608057 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:30.611133 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:30.616782 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:30.617242 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:30.617860 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:30.618572 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:30.619014 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:30.619450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:30.756104 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:30.763825 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd1910b1-7958-4988-98cf-556342caf76e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.160401 Aug 31 04:11:30.764401 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 329/657] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:30 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:31.785026 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:31.785666 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:31.788377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:31.794120 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:31.794578 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:31.795041 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:31.795757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:31.796201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:31.796617 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:31.847699 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-bca44674-37ed-4600-9580-562fc153a200 req-95c68b8b-488d-45dd-a5e7-fd802383e5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d85740-5090-4429-a8fb-61391968c231", "name": "network-vif-plugged", "status": "completed", "tag": "0319ee82-d626-405b-8c17-c745da1ac289"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:31.859918 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bca44674-37ed-4600-9580-562fc153a200 req-95c68b8b-488d-45dd-a5e7-fd802383e5c4 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:31.861026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bca44674-37ed-4600-9580-562fc153a200 req-95c68b8b-488d-45dd-a5e7-fd802383e5c4 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:31.862592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-bca44674-37ed-4600-9580-562fc153a200 req-95c68b8b-488d-45dd-a5e7-fd802383e5c4 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:31.875819 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-bca44674-37ed-4600-9580-562fc153a200 req-95c68b8b-488d-45dd-a5e7-fd802383e5c4 service nova] Creating event network-vif-plugged:0319ee82-d626-405b-8c17-c745da1ac289 for instance d1d85740-5090-4429-a8fb-61391968c231 on hv-cinder-85391 Aug 31 04:11:31.882275 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-bca44674-37ed-4600-9580-562fc153a200 req-95c68b8b-488d-45dd-a5e7-fd802383e5c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038318 Aug 31 04:11:31.883098 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 330/658] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:11:31.950559 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:31.958864 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d4d8a2c3-38eb-4378-9531-229858a75cf0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.177868 Aug 31 04:11:31.959509 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 329/659] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:31 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:32.983783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:32.985256 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:32.992875 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:32.993417 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:32.993844 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:32.994522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:32.994967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:32.995416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:33.190242 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:33.200244 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b76f77e6-6859-48d9-8b74-025f1eee1734 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1267 microversion: 2.1 time: 0.223194 Aug 31 04:11:33.200831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 331/660] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:32 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:34.223467 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:34.224080 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:34.226337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:11:34.226490 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Wed Aug 31 04:11:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 (ip 10.222.0.18) !!! Aug 31 04:11:34.233608 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:34.234421 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:34.234848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:34.235701 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:34.236131 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:34.236563 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:34.370766 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:34.382694 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-dfb5a4ca-42f0-44f6-8d9c-0dfa2d3fc364 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1455 microversion: 2.1 time: 0.164145 Aug 31 04:11:34.383500 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 330/661] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:34 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:34.402779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:34.403426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:34.410162 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:34.410647 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:34.411068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:34.411780 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:34.412221 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:34.412635 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:34.544269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:34.552227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-407c4378-373c-4edc-8d33-923808c4f280 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1455 microversion: 2.1 time: 0.153341 Aug 31 04:11:34.552774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 332/662] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:34 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:36.255556 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-d47d709d-e04a-427c-bf25-fdb0643f0848 req-42e39ac8-9888-4e94-9cb5-b0501d2c1d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d85740-5090-4429-a8fb-61391968c231", "tag": "0319ee82-d626-405b-8c17-c745da1ac289"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:36.269671 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-d47d709d-e04a-427c-bf25-fdb0643f0848 req-42e39ac8-9888-4e94-9cb5-b0501d2c1d54 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:36.269671 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-d47d709d-e04a-427c-bf25-fdb0643f0848 req-42e39ac8-9888-4e94-9cb5-b0501d2c1d54 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:36.269671 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-d47d709d-e04a-427c-bf25-fdb0643f0848 req-42e39ac8-9888-4e94-9cb5-b0501d2c1d54 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:36.278817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-d47d709d-e04a-427c-bf25-fdb0643f0848 req-42e39ac8-9888-4e94-9cb5-b0501d2c1d54 service nova] Creating event network-changed:0319ee82-d626-405b-8c17-c745da1ac289 for instance d1d85740-5090-4429-a8fb-61391968c231 on hv-cinder-85391 Aug 31 04:11:36.284542 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-d47d709d-e04a-427c-bf25-fdb0643f0848 req-42e39ac8-9888-4e94-9cb5-b0501d2c1d54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032645 Aug 31 04:11:36.288163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 331/663] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:37.582554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1512982465"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:37.583142 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:37.589909 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:37.590385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:37.590796 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:37.591543 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:37.591999 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:37.592423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:37.735048 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.network.security_group_api [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Removing security group 1dfbc972-4426-4788-bce2-d653baa582a2 from port 2b4e274a-7f96-4559-a287-f29400ea3c90 Aug 31 04:11:38.054156 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-df89acae-140a-47b0-8a05-33f4a387801a tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "POST /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/action" status: 202 len: 0 microversion: 2.1 time: 0.477757 Aug 31 04:11:38.054772 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 333/664] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:11:37 2022] POST /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:11:38.304374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-84ca8bdf-1a58-4013-b90a-70dfc93c7c02 req-c38af8cf-fb6c-4224-baba-feb3b24bd25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb2046f-ab11-422b-9573-3188818a82f8", "tag": "2b4e274a-7f96-4559-a287-f29400ea3c90"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:38.315769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-84ca8bdf-1a58-4013-b90a-70dfc93c7c02 req-c38af8cf-fb6c-4224-baba-feb3b24bd25e service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:38.316475 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-84ca8bdf-1a58-4013-b90a-70dfc93c7c02 req-c38af8cf-fb6c-4224-baba-feb3b24bd25e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:38.317110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-84ca8bdf-1a58-4013-b90a-70dfc93c7c02 req-c38af8cf-fb6c-4224-baba-feb3b24bd25e service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:38.329501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-84ca8bdf-1a58-4013-b90a-70dfc93c7c02 req-c38af8cf-fb6c-4224-baba-feb3b24bd25e service nova] Creating event network-changed:2b4e274a-7f96-4559-a287-f29400ea3c90 for instance 4eb2046f-ab11-422b-9573-3188818a82f8 on hv-cinder-85391 Aug 31 04:11:38.336468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-84ca8bdf-1a58-4013-b90a-70dfc93c7c02 req-c38af8cf-fb6c-4224-baba-feb3b24bd25e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035983 Aug 31 04:11:38.337813 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 332/665] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:39.525089 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:39.525694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:39.532161 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:39.532648 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:39.533088 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:39.533966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:39.534325 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:39.534759 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:39.618884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lazy-loading 'services' on Instance uuid 4eb2046f-ab11-422b-9573-3188818a82f8 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:11:39.707245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-98c60f3b-26c6-47f6-9cd8-4c8b5bf0b54e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments/bb66874c-7505-4436-a379-fe807124f95d" status: 202 len: 0 microversion: 2.1 time: 0.186600 Aug 31 04:11:39.707861 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 334/666] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:11:39 2022] DELETE /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments/bb66874c-7505-4436-a379-fe807124f95d => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:11:39.717515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:39.719833 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:39.726578 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:39.727061 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:39.727614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:39.728487 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:39.729094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:39.729700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:39.762056 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-654b4f5b-4154-4d69-bd91-bec7fb4e359e tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049572 Aug 31 04:11:39.762629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 333/667] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:11:39 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:40.356367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-c7539338-21d9-40f3-bffa-03ec4b31e3ca req-04bd2b42-eed4-4e54-aa61-8c838f661ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb2046f-ab11-422b-9573-3188818a82f8", "tag": "2b4e274a-7f96-4559-a287-f29400ea3c90"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:40.367627 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c7539338-21d9-40f3-bffa-03ec4b31e3ca req-04bd2b42-eed4-4e54-aa61-8c838f661ddc service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:40.368223 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c7539338-21d9-40f3-bffa-03ec4b31e3ca req-04bd2b42-eed4-4e54-aa61-8c838f661ddc service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:40.368920 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c7539338-21d9-40f3-bffa-03ec4b31e3ca req-04bd2b42-eed4-4e54-aa61-8c838f661ddc service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:40.383117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-c7539338-21d9-40f3-bffa-03ec4b31e3ca req-04bd2b42-eed4-4e54-aa61-8c838f661ddc service nova] Creating event network-changed:2b4e274a-7f96-4559-a287-f29400ea3c90 for instance 4eb2046f-ab11-422b-9573-3188818a82f8 on hv-cinder-85391 Aug 31 04:11:40.388248 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-c7539338-21d9-40f3-bffa-03ec4b31e3ca req-04bd2b42-eed4-4e54-aa61-8c838f661ddc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037001 Aug 31 04:11:40.388916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 335/668] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:11:40.774959 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:40.777036 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:40.783696 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:40.784411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:40.784842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:40.785536 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:40.785987 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:40.786405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:40.816572 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1d2e7903-75b3-4f81-a807-e08b99ae75d2 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045408 Aug 31 04:11:40.816879 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 334/669] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:11:40 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:11:40.828616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:40.829186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:40.836145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:40.836619 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:40.837052 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:40.837741 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:40.838390 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:40.838801 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:40.917286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] HTTP exception thrown: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 is not attached to volume bb66874c-7505-4436-a379-fe807124f95d Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Request method failure captured: Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments/bb66874c-7505-4436-a379-fe807124f95d HTTP/1.1 Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt7eu3Zv4Sr1Jan1drCRcs7oDeqohNAHF83IkQtP5IHA1xLrY2rFojOsfJ6Qq0VU3XHvBT7RvMgYJTV_pQGALt3ecZpM6Iu-TcFXlkKYhm_X_DPY-9nPMFUp9hCnAOv5EmDv2Zkpq_8L8gmRGsxy5w49D-GZV_UTW7f0Jffy_E8daxk Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: dfefc6f232404c6ca48d073df67c3907 Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestMinimumBasicScenario-278073397 Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:11:40.919752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfefc6f232404c6ca48d073df67c3907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfefc6f232404c6ca48d073df67c3907"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfefc6f232404c6ca48d073df67c3907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfefc6f232404c6ca48d073df67c3907", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestMinimumBasicScenario-278073397 Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: dfefc6f232404c6ca48d073df67c3907 Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestMinimumBasicScenario-278073397 Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-TestMinimumBasicScenario-278073397-project Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 7129e53818ce43078fdea24108da5d39 Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestMinimumBasicScenario-278073397-project Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:11:40.921397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 is not attached to volume bb66874c-7505-4436-a379-fe807124f95d Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'server_id': '4eb2046f-ab11-422b-9573-3188818a82f8', 'id': 'bb66874c-7505-4436-a379-fe807124f95d'} Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bb66874c-7505-4436-a379-fe807124f95d. Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:11:40.922279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 is not attached to volume bb66874c-7505-4436-a379-fe807124f95d Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 is not attached to volume bb66874c-7505-4436-a379-fe807124f95d Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:40.923784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Returning 404 to user: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 is not attached to volume bb66874c-7505-4436-a379-fe807124f95d {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:11:40.925432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-20e62001-dea8-414d-99e6-fb05617d34c6 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments/bb66874c-7505-4436-a379-fe807124f95d" status: 404 len: 154 microversion: 2.1 time: 0.097591 Aug 31 04:11:40.925432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 336/670] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:11:40 2022] DELETE /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8/os-volume_attachments/bb66874c-7505-4436-a379-fe807124f95d => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:11:42.075665 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:42.076180 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:42.083268 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:42.083745 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:42.084176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:42.084860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:42.085310 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:42.085728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:42.111914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:11:42.137634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:42.189362 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-eaf7cd98-c79b-468a-8566-2813050de927 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 204 len: 0 microversion: 2.1 time: 0.117262 Aug 31 04:11:42.194502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 335/671] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:11:42 2022] DELETE /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:11:42.199560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:42.200178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:42.207236 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:42.207748 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:42.208176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:42.208863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:42.209306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:42.209725 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:42.344304 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:42.352699 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a3ad4c5e-88aa-40b9-b793-b19a187b18b4 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1554 microversion: 2.1 time: 0.157101 Aug 31 04:11:42.353272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 337/672] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:42 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:43.375063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:43.375755 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:43.383116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:43.383581 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:43.384006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:43.384685 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:43.385127 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:43.385538 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:43.523991 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:43.534444 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-db30679d-739e-47d8-8bf6-c9a8d0be83f3 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1554 microversion: 2.1 time: 0.164001 Aug 31 04:11:43.535047 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 336/673] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:43 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:44.559456 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:44.560074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:44.566835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:44.567366 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:44.567797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:44.568481 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:44.568925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:44.569339 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:44.822434 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-ce8913de-1cce-4bb7-a878-f462b8496c2b req-31b82480-832c-4f6a-986b-530b9dfb73e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb2046f-ab11-422b-9573-3188818a82f8", "name": "network-vif-deleted", "tag": "2b4e274a-7f96-4559-a287-f29400ea3c90"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:44.823274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7129e53818ce43078fdea24108da5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefc6f232404c6ca48d073df67c3907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:44.834457 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ce8913de-1cce-4bb7-a878-f462b8496c2b req-31b82480-832c-4f6a-986b-530b9dfb73e9 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:44.834932 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ce8913de-1cce-4bb7-a878-f462b8496c2b req-31b82480-832c-4f6a-986b-530b9dfb73e9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:44.835626 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6ecacfd7-223c-4879-ad1d-849e7cce3976 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 200 len: 1554 microversion: 2.1 time: 0.280071 Aug 31 04:11:44.835761 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ce8913de-1cce-4bb7-a878-f462b8496c2b req-31b82480-832c-4f6a-986b-530b9dfb73e9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:44.837000 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 338/674] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:44 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 1554 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:11:44.850148 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-ce8913de-1cce-4bb7-a878-f462b8496c2b req-31b82480-832c-4f6a-986b-530b9dfb73e9 service nova] Creating event network-vif-deleted:2b4e274a-7f96-4559-a287-f29400ea3c90 for instance 4eb2046f-ab11-422b-9573-3188818a82f8 on hv-cinder-85391 Aug 31 04:11:44.855004 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-ce8913de-1cce-4bb7-a878-f462b8496c2b req-31b82480-832c-4f6a-986b-530b9dfb73e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036891 Aug 31 04:11:44.855643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 337/675] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:11:45.858140 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:45.859110 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] [instance: 4eb2046f-ab11-422b-9573-3188818a82f8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:45.865166 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:45.865647 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:45.866140 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:45.866839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:45.867313 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:45.867728 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:45.881863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] HTTP exception thrown: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 could not be found. Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Request method failure captured: Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 HTTP/1.1 Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt7eu3Zv4Sr1Jan1drCRcs7oDeqohNAHF83IkQtP5IHA1xLrY2rFojOsfJ6Qq0VU3XHvBT7RvMgYJTV_pQGALt3ecZpM6Iu-TcFXlkKYhm_X_DPY-9nPMFUp9hCnAOv5EmDv2Zkpq_8L8gmRGsxy5w49D-GZV_UTW7f0Jffy_E8daxk Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: dfefc6f232404c6ca48d073df67c3907 Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestMinimumBasicScenario-278073397 Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:11:45.883403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfefc6f232404c6ca48d073df67c3907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfefc6f232404c6ca48d073df67c3907"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfefc6f232404c6ca48d073df67c3907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfefc6f232404c6ca48d073df67c3907", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestMinimumBasicScenario-278073397 Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: dfefc6f232404c6ca48d073df67c3907 Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestMinimumBasicScenario-278073397 Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-TestMinimumBasicScenario-278073397-project Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 7129e53818ce43078fdea24108da5d39 Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestMinimumBasicScenario-278073397-project Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 could not be found. Aug 31 04:11:45.884993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '4eb2046f-ab11-422b-9573-3188818a82f8'} Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 could not be found. Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:11:45.885831 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 could not be found. Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 could not be found. Aug 31 04:11:45.887260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:11:45.888569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Returning 404 to user: Instance 4eb2046f-ab11-422b-9573-3188818a82f8 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:11:45.888569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ebd7b77e-c1d6-4d49-a019-daac3dff6cb1 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8" status: 404 len: 111 microversion: 2.1 time: 0.030954 Aug 31 04:11:45.888569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 339/676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:11:45 2022] GET /compute/v2.1/servers/4eb2046f-ab11-422b-9573-3188818a82f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:11:45.894803 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-27740e86-778b-4d40-ac05-8c65088ae785 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] Calling method '.version_select at 0x7f88ad2e9c10>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:45.915749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-27740e86-778b-4d40-ac05-8c65088ae785 tempest-TestMinimumBasicScenario-278073397 tempest-TestMinimumBasicScenario-278073397-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1080942642" status: 202 len: 0 microversion: 2.1 time: 0.025499 Aug 31 04:11:45.916309 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 338/677] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Aug 31 04:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1080942642 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:11:52.304226 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:52.304751 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:52.310895 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:52.311677 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:52.312104 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:52.312788 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:52.314260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:52.314656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:52.317652 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:52.342656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c16ebaef-bd1e-4bd4-9534-88024f13a485 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/ips" status: 200 len: 152 microversion: 2.20 time: 0.115244 Aug 31 04:11:52.347115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 340/678] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Aug 31 04:11:52 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/ips => generated 152 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 04:11:54.610939 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:11:54.611582 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:54.618646 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:54.619157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:54.619593 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:54.620320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:54.620757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:54.621178 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:54.646784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lazy-loading 'flavor' on Instance uuid 0b117348-7be9-4bab-800d-3bb55db4f771 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:11:54.836194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-53de8190-c231-4b71-92c9-96405a8794a4 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/action" status: 202 len: 0 microversion: 2.20 time: 0.230883 Aug 31 04:11:54.836832 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 339/679] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 31 04:11:54 2022] POST /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:11:54.847149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:54.847812 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:54.854964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:54.855467 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:54.855978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:54.856766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:54.857290 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:54.857713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:55.002397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:55.012126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:55.013580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:55.014746 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d29eda2f-dccc-4848-9618-233298f878e9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.172456 Aug 31 04:11:55.015384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 341/680] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:54 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:11:56.039695 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:56.040388 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:56.047341 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:56.047821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:56.048251 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:56.048934 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:56.049382 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:56.049802 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:56.188327 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:56.196501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:56.197932 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:56.199114 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-34302787-46bc-4d8a-87de-7d40922d31ab tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.164678 Aug 31 04:11:56.199690 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 340/681] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:56 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:11:57.226145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:57.226839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:57.234940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:57.235511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:57.235990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:57.236754 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:57.237260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:57.237729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:57.376744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:57.385598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:57.387038 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:57.388218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0aa39ab7-e4da-44c2-9b20-46d1d5017ab2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.168412 Aug 31 04:11:57.388773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 342/682] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:57 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:11:58.413782 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:58.414625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:58.424418 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:58.425103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:58.425718 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:58.426697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:58.427412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:58.428011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:58.579508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:58.588157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:58.589589 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:58.590890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-15576b4e-bc87-439d-81ae-98d8a38a830a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.182703 Aug 31 04:11:58.591520 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 341/683] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:58 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:11:59.619646 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:11:59.620186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:11:59.626992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:59.627511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:59.627941 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:59.628624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:11:59.629093 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:11:59.629511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:11:59.766886 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:59.777439 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:59.778859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:11:59.780061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3eb2900e-c27b-4f2c-befe-05fda293f516 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.165097 Aug 31 04:11:59.780625 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 343/684] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:11:59 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:00.574043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:00.574602 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:00.581250 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:00.581760 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:00.582201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:00.582878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:00.583420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:00.583759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:00.684245 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lazy-loading 'services' on Instance uuid cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:12:00.757933 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-df178a13-69cc-4c83-9afd-2134d5520bec tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments/2cb355a8-737a-4688-a754-51ba56f2178e" status: 202 len: 0 microversion: 2.1 time: 0.187912 Aug 31 04:12:00.758909 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 342/685] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:12:00 2022] DELETE /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments/2cb355a8-737a-4688-a754-51ba56f2178e => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:12:00.767574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:00.769875 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:00.782508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=30 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:00.788264 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:00.788777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:00.790233 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:00.790943 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:00.791613 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:00.792078 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:00.803860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:00.804570 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:00.812457 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:00.812948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:00.813370 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:00.814066 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:00.814512 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:00.814927 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:00.826821 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c38f08a7-5353-46b1-97aa-560077300ed0 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063364 Aug 31 04:12:00.832125 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 344/686] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:12:00 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:00.957384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:00.965688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:00.967150 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:00.968331 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-520b6608-6c9a-4f6c-8418-92a080fcbf00 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.169060 Aug 31 04:12:00.968931 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 343/687] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:00 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:01.845973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:01.849785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:01.856650 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:01.857132 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:01.857562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:01.858251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:01.859056 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:01.859482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:01.888433 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-631fb792-8b80-4c97-9b4f-0e2063f2685a tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050720 Aug 31 04:12:01.888990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 345/688] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:12:01 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:12:01.987349 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:01.987910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:01.990242 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:01.992239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:01.993069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:01.996706 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:01.997195 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:01.997627 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:01.998306 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:01.998957 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:01.999426 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:01.999530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:01.999987 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:02.000402 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:02.001089 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:02.001603 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:02.002038 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:02.026227 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:12:02.109201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-443b78ac-3873-448a-a72c-1b4d9927c45b tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 204 len: 0 microversion: 2.1 time: 0.126524 Aug 31 04:12:02.109926 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 344/689] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:12:01 2022] DELETE /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:12:02.119874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:02.120562 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:02.127593 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:02.128098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:02.128524 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:02.129209 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:02.129716 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:02.130132 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:02.145945 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:02.154495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:02.155981 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:02.157180 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-60406b45-c901-471c-b3bd-315a4538c288 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.169506 Aug 31 04:12:02.157742 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 346/690] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:01 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:12:02.266316 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:02.277292 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0029c17d-ad87-4035-ab75-4b4c8e990891 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1688 microversion: 2.1 time: 0.162417 Aug 31 04:12:02.278081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 345/691] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:02 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:12:02.963479 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:02.963998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:02.970147 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:02.970624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:02.971056 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:02.971760 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:02.972206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:02.972621 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:02.996972 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e389ee0d-dc1e-41d3-8bd5-21d24cb8e94b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/ips" status: 200 len: 150 microversion: 2.1 time: 0.217954 Aug 31 04:12:02.997537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 347/692] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:12:02 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/ips => generated 150 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:03.186686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:03.187454 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:03.194646 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:03.195270 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:03.195764 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:03.196768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:03.197014 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:03.197474 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:03.298591 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:03.299378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:03.308937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:03.309878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:03.310833 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:03.311961 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:03.312653 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:03.313271 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:03.351374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:03.361213 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:03.362878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:03.364138 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-05942be7-1151-49d1-88ac-8ede8050e125 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.182488 Aug 31 04:12:03.364711 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 346/693] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:03 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:03.454608 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:03.462988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8c0f86c0-7443-44f4-bc78-81c4dc63c63f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1688 microversion: 2.1 time: 0.169030 Aug 31 04:12:03.463591 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 348/694] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:03 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:04.385616 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fe2d689-55e5-4be1-9fc2-53a6d67798b5"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:04.387596 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:04.388019 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:04.388319 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:04.394907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:04.395143 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:04.395405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:04.395743 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:04.395857 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:04.396278 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:04.396502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:04.396947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:04.397053 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:04.397480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:04.397775 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:04.398207 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:04.531080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:04.539168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:04.540592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:04.541776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b0f3b7b2-5b6a-4cff-9f4f-57009eb32935 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.158167 Aug 31 04:12:04.542367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 349/695] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:04 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:04.546647 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:04.547236 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:04.552766 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:04.553249 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:04.554103 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:04.554664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:04.555116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:04.555532 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:04.688889 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:04.698887 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a7b7e93a-267d-4613-bb15-fc40d0b94bc9 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1688 microversion: 2.1 time: 0.155587 Aug 31 04:12:04.699486 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 350/696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:04 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:05.564250 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:05.564955 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:05.572062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:05.572549 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:05.572978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:05.573670 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:05.574118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:05.574553 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:05.681828 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=90,nova_cell1:INSERT=4 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:05.703347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e0977602-8e2e-47ab-a110-4305032cbc8e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.321684 Aug 31 04:12:05.704124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 347/697] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:12:04 2022] POST /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments => generated 194 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:05.725660 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:05.728133 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:05.746222 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:05.746713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:05.747180 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:05.747895 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:05.748414 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:05.748754 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:05.756690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:05.775845 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:05.777271 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:05.778444 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2c6a8122-5077-4cfe-9e1c-1a6314173471 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.218318 Aug 31 04:12:05.779016 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 351/698] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:05 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:05.994721 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:06.003170 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7a199d84-6f97-46cb-b271-4c6ebb0bc974 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1688 microversion: 2.1 time: 0.282235 Aug 31 04:12:06.003799 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 348/699] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:05 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1688 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:06.717362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-5d571e99-4264-4f78-8e8f-f6fd1bbad9b8 req-82f3bced-68e8-4f02-891f-eedab15be0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfefb434-dbeb-4fcc-8ebd-8603ee9beae9", "name": "network-vif-deleted", "tag": "18837e08-59b6-49b1-b900-0ef749916fb5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:06.729225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5d571e99-4264-4f78-8e8f-f6fd1bbad9b8 req-82f3bced-68e8-4f02-891f-eedab15be0d6 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:06.729812 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5d571e99-4264-4f78-8e8f-f6fd1bbad9b8 req-82f3bced-68e8-4f02-891f-eedab15be0d6 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:06.730327 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5d571e99-4264-4f78-8e8f-f6fd1bbad9b8 req-82f3bced-68e8-4f02-891f-eedab15be0d6 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:06.742245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-5d571e99-4264-4f78-8e8f-f6fd1bbad9b8 req-82f3bced-68e8-4f02-891f-eedab15be0d6 service nova] Creating event network-vif-deleted:18837e08-59b6-49b1-b900-0ef749916fb5 for instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 on hv-cinder-85391 Aug 31 04:12:06.747777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-5d571e99-4264-4f78-8e8f-f6fd1bbad9b8 req-82f3bced-68e8-4f02-891f-eedab15be0d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088784 Aug 31 04:12:06.751412 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 352/700] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:06.808126 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:06.813331 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:06.842275 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:06.842775 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:06.843244 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:06.843950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:06.844395 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:06.848047 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:07.029948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:07.030849 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:07.032364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:07.040263 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:07.040813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:07.041253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:07.042113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:07.042576 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:07.042996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:07.046131 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:07.048276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:07.050209 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9370a336-200f-4838-9fa1-280d109191f5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.252277 Aug 31 04:12:07.055190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 349/701] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:06 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:07.082047 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:07.086876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:07.086876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:07.086876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lazy-loading 'fault' on Instance uuid cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:12:07.131827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:07.142429 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9275f330-e1be-49d4-94e1-cde462d84845 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 200 len: 1334 microversion: 2.1 time: 0.121952 Aug 31 04:12:07.143019 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 353/702] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:07 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 1334 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:08.074083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:08.074640 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:08.081119 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:08.081597 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:08.082016 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:08.082691 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:08.083162 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:08.083570 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:08.165931 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:08.166496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: cfefb434-dbeb-4fcc-8ebd-8603ee9beae9] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:08.173385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:08.173879 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:08.174316 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:08.174994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:08.175504 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:08.175933 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:08.190295 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] HTTP exception thrown: Instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 could not be found. Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Request method failure captured: Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 HTTP/1.1 Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LN2xm1e7l3XFMnWbmEAaROgQ1gXyS3SqClPo4af2j-ozeboSvhGYasV6hYLHuQvowyA6i4IHjFdIknTIaMgM0CMmswvcO0WF5hoAo9nRPMTue_8211fo0yFb6dVUNAQm55ga87eUbSE5aajuJrQBereu438VnS_rxuCv2jqmIXTQ Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:12:08.192008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_490f695240294bbaa99f5eaa1e32b977", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 77fb76da34bf44a1b214a08bb4b8e51b Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 could not be found. Aug 31 04:12:08.194329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'cfefb434-dbeb-4fcc-8ebd-8603ee9beae9'} Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 could not be found. Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:12:08.195211 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 could not be found. Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 could not be found. Aug 31 04:12:08.196405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:08.198126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Returning 404 to user: Instance cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:12:08.198126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0914edb1-fc79-4660-b670-5fe0ba79ea6f tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9" status: 404 len: 111 microversion: 2.1 time: 0.032129 Aug 31 04:12:08.198126 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 354/703] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:08 2022] GET /compute/v2.1/servers/cfefb434-dbeb-4fcc-8ebd-8603ee9beae9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:12:08.202364 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e101e9ba-daf3-4069-a558-3fa1c8259dcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '.version_select at 0x7f88ad2d1d30>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:08.223847 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e101e9ba-daf3-4069-a558-3fa1c8259dcb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81108730" status: 202 len: 0 microversion: 2.1 time: 0.025090 Aug 31 04:12:08.224467 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 355/704] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Aug 31 04:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81108730 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:12:08.229653 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:08.239546 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:08.241004 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:08.242339 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f220692d-4378-4e19-8273-150d99fa7ee0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.172097 Aug 31 04:12:08.242939 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 350/705] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:08 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:09.269613 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:09.270602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:09.282753 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:09.283612 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:09.284384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:09.285534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:09.286522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:09.287261 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:09.429139 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:09.437987 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:09.439461 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:09.440691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3b53d8cb-91d2-477d-9257-716e0c4e7ab0 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.178388 Aug 31 04:12:09.441184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 356/706] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:09 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:10.464439 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:10.465075 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:10.471735 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:10.472285 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:10.472707 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:10.473433 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:10.473933 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:10.474348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:10.616358 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:10.625730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:10.627233 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:10.628469 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-31a5414c-36b0-4938-9963-8f63e2bc0838 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.168250 Aug 31 04:12:10.629051 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 351/707] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:10 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:11.406283 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:11.406803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:11.413630 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:11.414150 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:11.414583 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:11.415301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:11.415757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:11.416179 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:11.441567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:12:11.492863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:11.521485 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3344a73f-7964-4a7b-bf0d-3c74a6295308 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 204 len: 0 microversion: 2.1 time: 0.118870 Aug 31 04:12:11.522069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 357/708] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:12:11 2022] DELETE /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:12:11.530408 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:11.531112 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:11.537686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:11.538173 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:11.538584 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:11.539416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:11.539872 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:11.540296 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:11.652649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:11.653245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:11.660199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:11.660697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:11.661129 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:11.661820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:11.662270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:11.662703 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:11.672147 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:11.680559 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7393bfdb-b440-4995-ae70-24b2280f0772 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1508 microversion: 2.1 time: 0.153553 Aug 31 04:12:11.681829 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 352/709] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:11 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:11.811064 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:11.823265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:11.825302 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:11.827005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d21ed7c3-f239-4276-b37d-00a3b23fec5d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1744 microversion: 2.20 time: 0.178868 Aug 31 04:12:11.827786 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 358/710] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:11 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:12:12.708293 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:12.709273 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:12.717054 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:12.717539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:12.717972 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:12.718661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:12.719144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:12.719568 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:12.853205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:12.853787 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:12.857222 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:12.860891 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:12.861374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:12.861805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:12.862497 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:12.862977 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:12.863422 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:12.865592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7faf6b0e-86bc-4612-99d7-4f3cc5c4266c tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1508 microversion: 2.1 time: 0.163749 Aug 31 04:12:12.866270 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 353/711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:12 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:12.997163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:13.005703 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:13.007161 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:13.008489 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4c5b11f1-aebf-4a8a-96c5-8d2923685610 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1744 microversion: 2.20 time: 0.159364 Aug 31 04:12:13.009168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 359/712] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:12 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:13.886268 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:13.887053 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:13.893802 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:13.894282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:13.894707 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:13.895423 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:13.895872 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:13.896291 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:14.033478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:14.043769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c47f58c6-e538-4f9a-9fe7-fc6ed52ded33 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1508 microversion: 2.1 time: 0.161781 Aug 31 04:12:14.044746 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 354/713] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:13 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:14.060258 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:14.060940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:14.067187 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:14.067828 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:14.068256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:14.069002 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:14.069327 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-7c513b81-0187-4bf5-bd3c-ca41955d3c42 req-d090f12b-6333-4bbd-b725-2dde9280b57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b117348-7be9-4bab-800d-3bb55db4f771", "name": "network-vif-plugged", "status": "completed", "tag": "9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:14.069882 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:14.069984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:14.079856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c513b81-0187-4bf5-bd3c-ca41955d3c42 req-d090f12b-6333-4bbd-b725-2dde9280b57b service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:14.080365 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c513b81-0187-4bf5-bd3c-ca41955d3c42 req-d090f12b-6333-4bbd-b725-2dde9280b57b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:14.080992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7c513b81-0187-4bf5-bd3c-ca41955d3c42 req-d090f12b-6333-4bbd-b725-2dde9280b57b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:14.098622 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-7c513b81-0187-4bf5-bd3c-ca41955d3c42 req-d090f12b-6333-4bbd-b725-2dde9280b57b service nova] Creating event network-vif-plugged:9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1 for instance 0b117348-7be9-4bab-800d-3bb55db4f771 on hv-cinder-85391 Aug 31 04:12:14.103560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-7c513b81-0187-4bf5-bd3c-ca41955d3c42 req-d090f12b-6333-4bbd-b725-2dde9280b57b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095860 Aug 31 04:12:14.104082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 360/714] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:14.208144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:14.217455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:14.218864 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:14.220874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1b24136e-0696-4d8f-89d3-c242c527dc98 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1744 microversion: 2.20 time: 0.174925 Aug 31 04:12:14.221477 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 355/715] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:14 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:14.886745 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-fc7f02d5-cf03-4008-bb31-4f50775a1a38 req-e265cfd1-5f50-4b76-9e05-c8718b00e2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9983bf-7a14-46ef-89bf-05fa2102ea35", "name": "network-vif-deleted", "tag": "6b575fcc-5e74-46cb-a2b3-d057f4200d55"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:14.902169 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fc7f02d5-cf03-4008-bb31-4f50775a1a38 req-e265cfd1-5f50-4b76-9e05-c8718b00e2cf service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:14.903112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fc7f02d5-cf03-4008-bb31-4f50775a1a38 req-e265cfd1-5f50-4b76-9e05-c8718b00e2cf service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:14.903859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fc7f02d5-cf03-4008-bb31-4f50775a1a38 req-e265cfd1-5f50-4b76-9e05-c8718b00e2cf service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:14.920135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-fc7f02d5-cf03-4008-bb31-4f50775a1a38 req-e265cfd1-5f50-4b76-9e05-c8718b00e2cf service nova] Creating event network-vif-deleted:6b575fcc-5e74-46cb-a2b3-d057f4200d55 for instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 on hv-cinder-85391 Aug 31 04:12:14.927251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-fc7f02d5-cf03-4008-bb31-4f50775a1a38 req-e265cfd1-5f50-4b76-9e05-c8718b00e2cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047281 Aug 31 04:12:14.928172 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 361/716] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:15.066043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:15.066659 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:15.073652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.074159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.074591 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.075461 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.082430 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.083779 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.143517 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.144283 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.145810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.146451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lazy-loading 'fault' on Instance uuid 3b9983bf-7a14-46ef-89bf-05fa2102ea35 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:12:15.201329 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:15.210466 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e4b7cbbc-8a53-4413-a385-53262f1fe671 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 200 len: 1311 microversion: 2.1 time: 0.149469 Aug 31 04:12:15.225512 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 356/717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:15 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:15.245940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:15.247386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:15.253998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.254733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.255593 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.256497 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.257972 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.258797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.415239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:15.424161 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:15.426041 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:15.427498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-91eb1f6e-df60-4da6-ab20-14552d350d0e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1739 microversion: 2.20 time: 0.186752 Aug 31 04:12:15.428878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 362/718] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:15 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:15.501926 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fe2d689-55e5-4be1-9fc2-53a6d67798b5"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:15.504775 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:15.511902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.512390 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.513131 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.514312 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.514775 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.515303 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.632812 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Invalid volume: volume 9fe2d689-55e5-4be1-9fc2-53a6d67798b5 is already attached to instances: 2a2ce931-07fc-460a-a503-f4cf14e7529f Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: POST /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments HTTP/1.1 Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 74 Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:12:15.634925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {"volumeAttachment": {"volumeId": "9fe2d689-55e5-4be1-9fc2-53a6d67798b5"}} Aug 31 04:12:15.636642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Invalid volume: volume 9fe2d689-55e5-4be1-9fc2-53a6d67798b5 is already attached to instances: 2a2ce931-07fc-460a-a503-f4cf14e7529f Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'server_id': '2a2ce931-07fc-460a-a503-f4cf14e7529f', 'body': {'volumeAttachment': {'volumeId': '9fe2d689-55e5-4be1-9fc2-53a6d67798b5'}}} Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9fe2d689-55e5-4be1-9fc2-53a6d67798b5 is already attached to instances: 2a2ce931-07fc-460a-a503-f4cf14e7529f Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:15.637540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9fe2d689-55e5-4be1-9fc2-53a6d67798b5 is already attached to instances: 2a2ce931-07fc-460a-a503-f4cf14e7529f Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:15.638967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:15.640465 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:15.640465 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:12:15.640465 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:12:15.640465 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9fe2d689-55e5-4be1-9fc2-53a6d67798b5 is already attached to instances: 2a2ce931-07fc-460a-a503-f4cf14e7529f Aug 31 04:12:15.640465 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:15.641956 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 400 to user: Invalid volume: volume 9fe2d689-55e5-4be1-9fc2-53a6d67798b5 is already attached to instances: 2a2ce931-07fc-460a-a503-f4cf14e7529f {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:12:15.643075 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b9fc124e-a615-4d3c-ade1-47afc3d1679e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145852 Aug 31 04:12:15.643888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 357/719] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:12:15 2022] POST /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments => generated 174 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:12:15.719210 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:15.719800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:15.732338 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.733624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.734454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.735382 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.736206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.736654 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.828277 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lazy-loading 'services' on Instance uuid 2a2ce931-07fc-460a-a503-f4cf14e7529f {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:12:15.912496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d5afb2f0-eb59-43e7-8811-c5013daaccfb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments/9fe2d689-55e5-4be1-9fc2-53a6d67798b5" status: 202 len: 0 microversion: 2.1 time: 0.197205 Aug 31 04:12:15.913220 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 363/720] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:12:15 2022] DELETE /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments/9fe2d689-55e5-4be1-9fc2-53a6d67798b5 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:12:15.930182 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:15.933093 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:15.943837 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.945661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.946285 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.947217 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:15.947825 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:15.948452 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:15.984545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-105e37c6-5be5-4f6b-856a-0aef8e3dea3d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066112 Aug 31 04:12:15.985762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 358/721] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:12:15 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:12:16.233446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:16.234526 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 3b9983bf-7a14-46ef-89bf-05fa2102ea35] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:16.241854 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:16.242380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:16.242822 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:16.243550 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:16.244324 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:16.244954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:16.260142 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] HTTP exception thrown: Instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 could not be found. Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Request method failure captured: Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 HTTP/1.1 Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LN2xm1e7l3XFMnWbmEAaROgQ1gXyS3SqClPo4af2j-ozeboSvhGYasV6hYLHuQvowyA6i4IHjFdIknTIaMgM0CMmswvcO0WF5hoAo9nRPMTue_8211fo0yFb6dVUNAQm55ga87eUbSE5aajuJrQBereu438VnS_rxuCv2jqmIXTQ Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:12:16.261916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_490f695240294bbaa99f5eaa1e32b977", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 77fb76da34bf44a1b214a08bb4b8e51b Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 could not be found. Aug 31 04:12:16.263525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '3b9983bf-7a14-46ef-89bf-05fa2102ea35'} Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 could not be found. Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:12:16.264371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 could not be found. Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 could not be found. Aug 31 04:12:16.265595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:16.266705 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Returning 404 to user: Instance 3b9983bf-7a14-46ef-89bf-05fa2102ea35 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:12:16.266705 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-be38fed8-61ab-4fa1-bc00-e0bc55347345 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35" status: 404 len: 111 microversion: 2.1 time: 0.034575 Aug 31 04:12:16.272620 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:16.273477 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:16.277239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 364/722] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:16 2022] GET /compute/v2.1/servers/3b9983bf-7a14-46ef-89bf-05fa2102ea35 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:12:16.280385 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:16.280877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:16.281316 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:16.282047 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:16.282494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:16.282895 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:16.310820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:12:16.424498 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-aa71f490-11b9-48d7-ab12-6353cd471396 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 204 len: 0 microversion: 2.1 time: 0.155596 Aug 31 04:12:16.427293 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 359/723] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:12:16 2022] DELETE /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:12:16.433725 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:16.434584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:16.442488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:16.443415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:16.444074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:16.445476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:16.447208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:16.447790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:16.452478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:16.453405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:16.459335 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:16.459996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:16.460836 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:16.461694 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:16.462325 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:16.462897 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:16.689809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:16.703532 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8c3a3400-25be-492a-bf02-e2988271465e tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.273617 Aug 31 04:12:16.704320 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 365/724] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:16 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:12:16.704556 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:16.715306 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:16.717323 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:16.718757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f95e99b9-6517-4351-9424-0f6334c3f631 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1739 microversion: 2.20 time: 0.271088 Aug 31 04:12:16.719515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 360/725] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:16 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:12:16.998342 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:17.001062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:17.007955 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:17.008436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:17.008872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:17.009571 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:17.010024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:17.010688 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:17.043129 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-201ef37b-3024-47c3-9f94-efb968cd0410 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048767 Aug 31 04:12:17.047565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 366/726] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:12:16 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:17.726288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:17.727066 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:17.734468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:17.734950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:17.737041 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:17.738002 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:17.738414 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:17.739059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:17.744178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:17.746272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:17.753616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:17.754382 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:17.755071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:17.756141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:17.756790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:17.757757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:17.991684 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:17.999623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b42ed60c-7ac2-4bcf-aa3a-4747470e52d1 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.277352 Aug 31 04:12:18.015665 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:18.019799 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 361/727] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:17 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:18.025111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:18.026739 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:18.028954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bae2f5e1-aa2e-4b25-b490-d69d751d0291 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1739 microversion: 2.20 time: 0.290707 Aug 31 04:12:18.029653 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 367/728] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:17 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:18.055613 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:18.057945 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:18.064269 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:18.064883 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:18.065469 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:18.066267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:18.066790 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:18.067328 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:18.072121 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:18.105692 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-da0e0a8a-2a7b-4a0d-9958-03d229cab463 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054469 Aug 31 04:12:18.107081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 362/729] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:12:18 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:19.029408 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:19.031619 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:19.041228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.041723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.042169 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.042885 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.043460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.043888 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.053763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:19.054697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:19.061174 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.061682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.062124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.062860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.063338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.063756 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.430837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:19.442792 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bc20e18e-0eb5-4933-8897-d4251fad39e6 tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1523 microversion: 2.1 time: 0.418911 Aug 31 04:12:19.455697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 368/730] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:19 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1523 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:19.464127 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:19.467622 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:19.470436 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:19.476470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.476869 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.477362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.478238 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.478935 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.479391 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.493912 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:19.495397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:19.496634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-21801b68-bc47-4284-a5b7-5f9f7691076b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1739 microversion: 2.20 time: 0.446743 Aug 31 04:12:19.497214 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 363/731] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:19 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:19.512152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-ced8f6db-7f08-41af-9661-b9acdffa80b0 req-233d19bb-2ab1-4029-b4eb-8ecba4d288a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05badbbb-888b-4ba8-8e63-c45489dabb5e", "name": "network-vif-deleted", "tag": "992c7f80-18c6-4637-bdf4-bbd2517f5794"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:19.519741 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-03366d34-ab54-41f8-84e3-4aa94b9d6c7f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062558 Aug 31 04:12:19.521067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 369/732] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:12:19 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:12:19.570672 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ced8f6db-7f08-41af-9661-b9acdffa80b0 req-233d19bb-2ab1-4029-b4eb-8ecba4d288a1 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.571732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ced8f6db-7f08-41af-9661-b9acdffa80b0 req-233d19bb-2ab1-4029-b4eb-8ecba4d288a1 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.572204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-ced8f6db-7f08-41af-9661-b9acdffa80b0 req-233d19bb-2ab1-4029-b4eb-8ecba4d288a1 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.588254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-ced8f6db-7f08-41af-9661-b9acdffa80b0 req-233d19bb-2ab1-4029-b4eb-8ecba4d288a1 service nova] Creating event network-vif-deleted:992c7f80-18c6-4637-bdf4-bbd2517f5794 for instance 05badbbb-888b-4ba8-8e63-c45489dabb5e on hv-cinder-85391 Aug 31 04:12:19.602241 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-ced8f6db-7f08-41af-9661-b9acdffa80b0 req-233d19bb-2ab1-4029-b4eb-8ecba4d288a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099661 Aug 31 04:12:19.616593 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 364/733] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:19.653767 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:19.653767 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:19.665255 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.666116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.667386 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.669949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.670617 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.673283 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.707815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:12:19.821531 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-46d3d0b9-2cb2-42fd-bb18-f14dad6d4e0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 204 len: 0 microversion: 2.1 time: 0.171894 Aug 31 04:12:19.822425 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 370/734] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:12:19 2022] DELETE /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:12:19.832064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:19.833044 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:19.843552 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.844606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.851630 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:19.852553 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:19.853292 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:19.853860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:20.007089 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:20.016364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-94becec0-a1fc-4422-9803-c0289a782b00 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1681 microversion: 2.1 time: 0.189135 Aug 31 04:12:20.016955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 365/735] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:19 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:20.466600 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:20.467397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:20.474645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:20.475174 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:20.475607 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:20.476387 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:20.476842 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:20.477236 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:20.513790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:20.514685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:20.515160 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:20.515618 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lazy-loading 'fault' on Instance uuid 05badbbb-888b-4ba8-8e63-c45489dabb5e {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:12:20.524566 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:20.525768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:20.533574 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:20.534194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:20.534978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:20.537751 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:20.538286 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:20.540095 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:20.565432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb76da34bf44a1b214a08bb4b8e51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490f695240294bbaa99f5eaa1e32b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:20.574347 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d04ddde2-a2d8-4f25-818c-c57e1c0208fb tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 200 len: 1312 microversion: 2.1 time: 0.112079 Aug 31 04:12:20.575515 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 371/736] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:20 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:20.713316 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:20.721652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:20.723350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:20.724703 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4c72b1e7-8db8-4cb0-800c-0d1d23faf4e6 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1739 microversion: 2.20 time: 0.204375 Aug 31 04:12:20.725267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 366/737] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:20 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:21.044251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:21.044948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:21.051463 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:21.052267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:21.052918 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:21.053901 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:21.054723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:21.055395 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:21.217127 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:21.225264 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c6d23d20-4a51-4da4-af73-87e5892cc927 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1681 microversion: 2.1 time: 0.185057 Aug 31 04:12:21.225939 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 372/738] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:21 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:21.601009 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:21.602343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] [instance: 05badbbb-888b-4ba8-8e63-c45489dabb5e] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:21.609456 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:21.610012 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:21.610508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:21.611222 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:21.612275 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:21.612888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:21.627442 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] HTTP exception thrown: Instance 05badbbb-888b-4ba8-8e63-c45489dabb5e could not be found. Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Request method failure captured: Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e HTTP/1.1 Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LN2xm1e7l3XFMnWbmEAaROgQ1gXyS3SqClPo4af2j-ozeboSvhGYasV6hYLHuQvowyA6i4IHjFdIknTIaMgM0CMmswvcO0WF5hoAo9nRPMTue_8211fo0yFb6dVUNAQm55ga87eUbSE5aajuJrQBereu438VnS_rxuCv2jqmIXTQ Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:12:21.629468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/490f695240294bbaa99f5eaa1e32b977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_490f695240294bbaa99f5eaa1e32b977", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: 490f695240294bbaa99f5eaa1e32b977 Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1514234924 Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 77fb76da34bf44a1b214a08bb4b8e51b Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1514234924-project Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 05badbbb-888b-4ba8-8e63-c45489dabb5e could not be found. Aug 31 04:12:21.631015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '05badbbb-888b-4ba8-8e63-c45489dabb5e'} Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05badbbb-888b-4ba8-8e63-c45489dabb5e could not be found. Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:12:21.635612 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05badbbb-888b-4ba8-8e63-c45489dabb5e could not be found. Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05badbbb-888b-4ba8-8e63-c45489dabb5e could not be found. Aug 31 04:12:21.637298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:12:21.639665 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] Returning 404 to user: Instance 05badbbb-888b-4ba8-8e63-c45489dabb5e could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:12:21.639665 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0cb01e1e-45af-4dbd-9f93-7d68910561ae tempest-ServerRescueNegativeTestJSON-1514234924 tempest-ServerRescueNegativeTestJSON-1514234924-project] 10.222.0.18 "GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e" status: 404 len: 111 microversion: 2.1 time: 0.033943 Aug 31 04:12:21.639665 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 367/739] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:21 2022] GET /compute/v2.1/servers/05badbbb-888b-4ba8-8e63-c45489dabb5e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:12:21.752910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:21.754416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:21.766069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:21.767476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:21.768632 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:21.769532 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:21.771536 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:21.772247 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:22.184086 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:22.186910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:22.214801 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:22.220305 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:22.222171 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-717fc26e-2717-4447-904a-4131cd04db9b tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1739 microversion: 2.20 time: 0.473389 Aug 31 04:12:22.238837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 373/740] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:21 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:22.248494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:22.249485 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:22.256074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:22.256845 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:22.257484 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:22.258375 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:22.258964 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:22.259583 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:22.680396 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:22.691662 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-16df80f3-552f-4e0e-949a-8012a0f94e1f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1681 microversion: 2.1 time: 0.446951 Aug 31 04:12:22.692942 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 368/741] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:22 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1681 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:23.246294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:23.246935 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:23.254710 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:23.255245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:23.255681 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:23.256701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:23.257755 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:23.258656 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:23.632016 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:23.641194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:23.642715 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:23.644278 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-63356b23-7df3-4e5a-9030-6cacee12da1a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1739 microversion: 2.20 time: 0.402012 Aug 31 04:12:23.645072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 374/742] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:23 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1739 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:23.716298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:23.716898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:23.723575 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:23.724069 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:23.724508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:23.725206 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:23.726999 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:23.727656 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:23.952851 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:23.965747 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-15530911-ddb4-4864-9fe5-9b36ea060506 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 200 len: 1614 microversion: 2.1 time: 0.253301 Aug 31 04:12:23.983604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 369/743] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:23 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 1614 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:24.153856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-e89a975f-ad21-43fe-95c6-302a4a9cea18 req-d97bd2d6-4efc-42e5-8fa4-1794c3fd6066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2ce931-07fc-460a-a503-f4cf14e7529f", "name": "network-vif-deleted", "tag": "28968224-df03-434c-92f2-71bec01daf3d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:24.169590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e89a975f-ad21-43fe-95c6-302a4a9cea18 req-d97bd2d6-4efc-42e5-8fa4-1794c3fd6066 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:24.171673 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e89a975f-ad21-43fe-95c6-302a4a9cea18 req-d97bd2d6-4efc-42e5-8fa4-1794c3fd6066 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:24.172320 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e89a975f-ad21-43fe-95c6-302a4a9cea18 req-d97bd2d6-4efc-42e5-8fa4-1794c3fd6066 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:24.202529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-e89a975f-ad21-43fe-95c6-302a4a9cea18 req-d97bd2d6-4efc-42e5-8fa4-1794c3fd6066 service nova] Creating event network-vif-deleted:28968224-df03-434c-92f2-71bec01daf3d for instance 2a2ce931-07fc-460a-a503-f4cf14e7529f on hv-cinder-85391 Aug 31 04:12:24.223351 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-e89a975f-ad21-43fe-95c6-302a4a9cea18 req-d97bd2d6-4efc-42e5-8fa4-1794c3fd6066 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068090 Aug 31 04:12:24.226594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 375/744] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:24.668187 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:24.668798 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:24.676020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:24.676489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:24.676926 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:24.678241 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:24.678721 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:24.679368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:24.870849 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:24.885884 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:24.887834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:24.892590 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bd4c96a4-c6b5-4642-abd3-332824c6dca7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1739 microversion: 2.20 time: 0.228253 Aug 31 04:12:24.893547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 370/745] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:24 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:24.997002 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:24.998282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:25.004782 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:25.005506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:25.006099 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:25.007104 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:25.007893 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:25.008475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:25.022966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f HTTP/1.1 Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:12:25.024944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:12:25.026517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '2a2ce931-07fc-460a-a503-f4cf14e7529f'} Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:12:25.027427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:12:25.028858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:12:25.030790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:12:25.031835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-88fcc2e3-00d1-4bc9-9166-4dd90cf66d2b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 404 len: 111 microversion: 2.1 time: 0.039567 Aug 31 04:12:25.032708 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 376/746] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:24 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:12:25.041664 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c8c2110b-b46b-4022-a8e0-b66d21b8f409 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '.version_select at 0x7f88ad1c7790>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:25.063626 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c8c2110b-b46b-4022-a8e0-b66d21b8f409 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-680554599" status: 202 len: 0 microversion: 2.1 time: 0.025748 Aug 31 04:12:25.064750 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 371/747] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 31 04:12:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-680554599 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:12:25.919069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:25.919689 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:25.926312 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:25.926971 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:25.927427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:25.928128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:25.929235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:25.929803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:26.454354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:26.464612 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:26.466152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:26.467454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f7d018de-d174-48de-9c9c-6f7bd33136ec tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1721 microversion: 2.20 time: 0.552667 Aug 31 04:12:26.468065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 377/748] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:25 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1721 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:26.597287 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7fe0b01d-e90f-4881-9e5e-18d74e15c8cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: .version_select at 0x7f88ad1970d0>, body: {"keypair": {"name": "tempest-keypair-1667769171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuFrak8DmXSReHtsCbuBZtamBIUP4dqVPwtOxxILTq9k1z9Ax11q3+jtLa37G8Q4T3KoqrvowrfY4DZ99WBQepHc/+Hl6bPyXllz6Jj42XjQeppG7+uUJtkdtFbaU6nQg=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:26.624226 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-7fe0b01d-e90f-4881-9e5e-18d74e15c8cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:12:26.628708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-7fe0b01d-e90f-4881-9e5e-18d74e15c8cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for user f80c8c1d6af7450eb8f936df231ad63b and project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:12:26.653362 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7fe0b01d-e90f-4881-9e5e-18d74e15c8cb tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059972 Aug 31 04:12:26.653915 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 372/749] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:12:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:27.494150 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:27.494826 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:27.501868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:27.502450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:27.502938 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:27.503895 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:27.504408 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:27.504888 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:27.681723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:27.692645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:27.694436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:27.696241 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-94fe792c-82ac-446b-b818-b97e1560541d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1721 microversion: 2.20 time: 0.208290 Aug 31 04:12:27.703390 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 378/750] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:27 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:28.030267 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-3b8d32da-83fb-447e-a05c-a75f0e000374 req-7a086f1d-3cc2-4fcf-97d4-d5f2958dbb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b117348-7be9-4bab-800d-3bb55db4f771", "name": "network-vif-unplugged", "status": "completed", "tag": "9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:28.050094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-3b8d32da-83fb-447e-a05c-a75f0e000374 req-7a086f1d-3cc2-4fcf-97d4-d5f2958dbb8f service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:28.050603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-3b8d32da-83fb-447e-a05c-a75f0e000374 req-7a086f1d-3cc2-4fcf-97d4-d5f2958dbb8f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:28.051054 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-3b8d32da-83fb-447e-a05c-a75f0e000374 req-7a086f1d-3cc2-4fcf-97d4-d5f2958dbb8f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:28.073485 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-3b8d32da-83fb-447e-a05c-a75f0e000374 req-7a086f1d-3cc2-4fcf-97d4-d5f2958dbb8f service nova] Creating event network-vif-unplugged:9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1 for instance 0b117348-7be9-4bab-800d-3bb55db4f771 on hv-cinder-85391 Aug 31 04:12:28.083890 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-3b8d32da-83fb-447e-a05c-a75f0e000374 req-7a086f1d-3cc2-4fcf-97d4-d5f2958dbb8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057179 Aug 31 04:12:28.084817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 373/751] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:28.160664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-660093326", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df2a7da3-c61f-4600-a4d7-00eeb18098d5"}], "security_groups": [{"name": "tempest-securitygroup--376178332"}], "key_name": "tempest-keypair-1667769171", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:28.285123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] validate_networks() for [('df2a7da3-c61f-4600-a4d7-00eeb18098d5', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:12:28.719219 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:28.720015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:28.727234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:28.727712 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:28.728136 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:28.728886 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:28.729460 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:28.729880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:28.841804 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:12:28.843135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:12:28.843724 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:12:28.844301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:12:28.844965 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:12:28.856221 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:28.857664 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:28.858413 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:28.859547 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:28.859994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:28.860421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:28.883865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:12:28.888461 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Getting quotas for user f80c8c1d6af7450eb8f936df231ad63b and project fdbbb020a1944de2a8fa16379f8cec7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:12:28.897662 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:28.898302 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:28.900610 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:12:28.902921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:12:28.907905 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:28.909051 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:28.910216 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-55335f02-81af-490b-a7fc-7a31c16e506c tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1664 microversion: 2.20 time: 0.195451 Aug 31 04:12:28.911107 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 374/752] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:28 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:28.935582 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5596ea1-72cb-4d0e-845b-86ebb85f9b10"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:28.939508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:28.946382 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:28.947174 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:28.947845 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:28.948734 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:28.949226 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:28.949608 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:28.962410 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2077f234-3ef0-47dd-a5a8-82af3a38c9fa tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.805962 Aug 31 04:12:28.963413 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 379/753] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:12:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:12:28.977971 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-476404e1-92a3-4306-99da-77d736f21d04 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:28.979412 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-476404e1-92a3-4306-99da-77d736f21d04 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:29.050417 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-476404e1-92a3-4306-99da-77d736f21d04 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:29.058924 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-476404e1-92a3-4306-99da-77d736f21d04 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1241 microversion: 2.1 time: 0.088872 Aug 31 04:12:29.059534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 380/754] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:28 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:12:29.320156 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-fd443268-dcd1-48ea-b3e4-af97ef4956b3 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.389038 Aug 31 04:12:29.321324 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 375/755] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Aug 31 04:12:28 2022] POST /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/os-volume_attachments => generated 188 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 04:12:29.496390 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:29.496880 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:29.503234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:29.503721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:29.504165 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:29.504847 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:29.505295 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:29.505715 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:29.772802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-977ab5e2-7852-436d-823e-5e8900a944bc tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/os-volume_attachments/e5596ea1-72cb-4d0e-845b-86ebb85f9b10" status: 202 len: 0 microversion: 2.20 time: 0.280324 Aug 31 04:12:29.774323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 381/756] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Aug 31 04:12:29 2022] DELETE /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/os-volume_attachments/e5596ea1-72cb-4d0e-845b-86ebb85f9b10 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 04:12:29.838929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:29.839917 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:29.846788 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:29.847434 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:29.848551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:29.849313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:29.849809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:29.850360 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:30.055606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120661) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 04:12:30.079828 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:30.080962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:30.087717 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:30.088419 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:30.089005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:30.089888 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:30.090343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:30.090778 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:30.152551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-30f245c4-7080-4354-b5c4-11a523471140 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "POST /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/action" status: 202 len: 0 microversion: 2.20 time: 0.318473 Aug 31 04:12:30.156676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 376/757] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 31 04:12:29 2022] POST /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:12:30.161894 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:30.162496 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:30.169856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:30.170243 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:30.170728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:30.171430 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:30.172335 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:30.172778 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:30.173487 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:30.191297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c6e0ad6a-0f95-4bad-9df4-5511b3806751 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1293 microversion: 2.1 time: 0.114632 Aug 31 04:12:30.192749 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 382/758] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:30 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:12:30.321012 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:30.330494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:30.332172 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:30.333705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f4f11bf9-c7de-4216-a958-5b02114f84d7 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1672 microversion: 2.20 time: 0.176054 Aug 31 04:12:30.335122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 377/759] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:30 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:31.213316 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:31.214069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:31.220454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:31.221168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:31.221775 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:31.222850 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:31.223490 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:31.224071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:31.317554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:31.326564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f2947546-85cd-43dc-95e9-1fc3b2edb190 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1299 microversion: 2.1 time: 0.117641 Aug 31 04:12:31.327427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 383/760] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:31 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:31.363275 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:31.365372 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:31.371722 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:31.380803 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:31.381809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:31.402260 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:31.403067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:31.403579 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:31.404010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:31.775741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:31.791572 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:31.793197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:31.794448 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9f0c2d2f-9ba8-4a28-b04e-f218bf4113bd tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1672 microversion: 2.20 time: 0.436583 Aug 31 04:12:31.795278 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 378/761] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:31 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1672 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:32.288933 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-37f24395-90a7-4852-aca7-2d91ebd560e3 req-fb57dabc-cbb1-427f-a01e-c4835102efb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08130b1d-540c-4ad8-a9b6-8a8aa11f3282", "tag": "1965184b-6e71-4d67-b3a6-30287c27fc61"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:32.298843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-37f24395-90a7-4852-aca7-2d91ebd560e3 req-fb57dabc-cbb1-427f-a01e-c4835102efb6 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:32.299347 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-37f24395-90a7-4852-aca7-2d91ebd560e3 req-fb57dabc-cbb1-427f-a01e-c4835102efb6 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:32.299774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-37f24395-90a7-4852-aca7-2d91ebd560e3 req-fb57dabc-cbb1-427f-a01e-c4835102efb6 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:32.310508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-37f24395-90a7-4852-aca7-2d91ebd560e3 req-fb57dabc-cbb1-427f-a01e-c4835102efb6 service nova] Creating event network-changed:1965184b-6e71-4d67-b3a6-30287c27fc61 for instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 on hv-cinder-85391 Aug 31 04:12:32.315588 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-37f24395-90a7-4852-aca7-2d91ebd560e3 req-fb57dabc-cbb1-427f-a01e-c4835102efb6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030349 Aug 31 04:12:32.316166 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 384/762] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:32.347385 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:32.348079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:32.354226 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:32.354709 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:32.355161 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:32.355849 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:32.356290 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:32.356701 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:32.361391 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:32.720961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:32.729644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0920bc42-9ab1-42c2-a459-c40be949dd1b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.386032 Aug 31 04:12:32.730411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 379/763] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:32 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:32.820840 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:32.821903 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:32.832284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:32.832792 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:32.833265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:32.834263 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:32.834921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:32.835564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:33.087881 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:33.098879 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:33.101495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:33.102632 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d314e12-07c9-48e9-8d86-33ad5fac6aa2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.286514 Aug 31 04:12:33.103591 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 385/764] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:32 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:33.751496 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:33.752271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:33.759621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:33.763333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:33.763333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:33.763333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:33.763333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:33.763846 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:34.087665 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:34.095499 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-81c53a31-ed0b-445c-907c-511e4d5a4429 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.347952 Aug 31 04:12:34.096065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 380/765] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:33 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:34.129586 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:34.130297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:34.136873 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:34.137429 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:34.137953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:34.138712 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:34.139285 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:34.139708 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:34.272264 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:34.280738 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:34.282260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:34.283540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8416878a-7cb4-4b4f-ac31-daae1f48ab87 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.157894 Aug 31 04:12:34.284177 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 386/766] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:34 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:35.117062 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:35.118423 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:35.125281 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:35.126070 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:35.126331 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:35.127220 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:35.127676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:35.128159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:35.292738 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:35.308464 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:35.309282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:35.323103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c283c957-a595-4fa8-82d4-48a5e9a13c7a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.204906 Aug 31 04:12:35.323103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 381/767] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:35 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:35.323344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:35.323344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:35.323344 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:35.323625 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:35.324273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:35.324861 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:35.467416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:35.475999 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:35.477685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:35.479067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-369edcf2-3334-46f9-964b-70a5413de090 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.176854 Aug 31 04:12:35.479819 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 387/768] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:35 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:36.346250 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:36.348125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:36.355871 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:36.356948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:36.357483 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:36.359190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:36.360004 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:36.360699 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:36.505321 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:36.506668 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:36.516598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:36.523879 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:36.524324 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:36.525066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:36.525573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:36.525929 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:36.532665 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:36.558011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7316e707-fbea-47c2-8051-50e4ac00c42c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.215344 Aug 31 04:12:36.563076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 382/769] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:36 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:36.801720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:36.815535 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:36.817252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:36.827837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-73d5cf4c-933c-4a3b-808d-74e063220bd8 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.326129 Aug 31 04:12:36.843716 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 388/770] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:36 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:12:37.578110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:37.578730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:37.583477 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=4 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:37.597435 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:37.597868 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:37.598312 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:37.599056 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:37.599504 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:37.600014 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:37.771953 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:37.780669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b721f46d-991e-437e-8ae4-d1514ac94478 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.206515 Aug 31 04:12:37.781349 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 383/771] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:37 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:37.870117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:37.870727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:37.877791 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:37.878282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:37.878940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:37.879682 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:37.880134 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:37.880562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:38.038973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:38.048885 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:38.050929 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:38.052368 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0c38820-7483-4a73-99d9-831e466406f2 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.186552 Aug 31 04:12:38.053180 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 389/772] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:37 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:38.197356 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-165783fa-ec12-438b-967f-8131300d4196 req-b9393a8e-6d95-49ce-9cb4-ab3f08dcae9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08130b1d-540c-4ad8-a9b6-8a8aa11f3282", "name": "network-vif-plugged", "status": "completed", "tag": "1965184b-6e71-4d67-b3a6-30287c27fc61"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:38.208798 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-165783fa-ec12-438b-967f-8131300d4196 req-b9393a8e-6d95-49ce-9cb4-ab3f08dcae9c service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:38.209515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-165783fa-ec12-438b-967f-8131300d4196 req-b9393a8e-6d95-49ce-9cb4-ab3f08dcae9c service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:38.210106 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-165783fa-ec12-438b-967f-8131300d4196 req-b9393a8e-6d95-49ce-9cb4-ab3f08dcae9c service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:38.227067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-165783fa-ec12-438b-967f-8131300d4196 req-b9393a8e-6d95-49ce-9cb4-ab3f08dcae9c service nova] Creating event network-vif-plugged:1965184b-6e71-4d67-b3a6-30287c27fc61 for instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 on hv-cinder-85391 Aug 31 04:12:38.233426 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-165783fa-ec12-438b-967f-8131300d4196 req-b9393a8e-6d95-49ce-9cb4-ab3f08dcae9c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039289 Aug 31 04:12:38.234313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 384/773] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:38.802675 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:38.803722 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:38.810014 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:38.810505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:38.810942 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:38.811673 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:38.812127 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:38.812534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:38.870072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:39.000169 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:39.009612 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8cee4674-2ef8-4f7b-99ac-f825d7c8897a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.210759 Aug 31 04:12:39.010974 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 390/774] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:38 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:39.076834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:39.078265 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:39.086350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:39.087350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:39.088077 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:39.089094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:39.089906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:39.090604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:39.254444 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:39.265802 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:39.267519 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:39.268902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bbd20957-6caf-4a30-8399-c888fc6f1657 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.197431 Aug 31 04:12:39.272317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 385/775] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:39 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:40.033143 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:40.033709 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:40.036802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=8 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:40.044739 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:40.045525 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:40.046118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:40.047207 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:40.047928 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:40.048540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:40.070184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:40.196046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:40.204487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-981016bb-3c7d-45b1-8816-5426ab370ecf tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.176933 Aug 31 04:12:40.205194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 391/776] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:40 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:40.295493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:40.296117 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:40.302840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:40.303470 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:40.303883 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:40.304582 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:40.305061 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:40.305463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:40.455450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:40.463732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:40.465152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:40.466317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-58a692ce-053e-4df6-b42c-cd4567c53071 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.174942 Aug 31 04:12:40.467259 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 386/777] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:40 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:41.228624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:41.229218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:41.236112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:41.236849 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:41.237598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:41.238478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:41.239292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:41.239936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:41.436208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:41.454359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1733ede2-4b37-4b03-bcf2-10ce851ca573 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.228073 Aug 31 04:12:41.455441 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 392/778] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:41 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:41.489623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:41.490346 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:41.498161 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:41.498745 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:41.499644 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:41.500878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:41.501636 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:41.502310 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:41.650444 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:41.661085 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:41.663489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:41.665772 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-020ac43f-6907-4b26-a04c-be2e40825917 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.180024 Aug 31 04:12:41.673795 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 387/779] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:41 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:42.476878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:42.477558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:42.485189 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:42.486012 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:42.486529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:42.487971 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:42.489176 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:42.489808 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:42.664489 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:42.672552 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cf3ced97-9d3e-4982-af6d-e18cb24c2428 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.199647 Aug 31 04:12:42.673145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 393/780] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:42 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:42.693002 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:42.693728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:42.700738 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:42.701231 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:42.701662 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:42.702365 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:42.703295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:42.703720 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:42.844316 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:42.854062 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:42.856164 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:42.857365 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ab7c09f5-de5f-4403-856c-c9de15569f56 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.169014 Aug 31 04:12:42.858280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 388/781] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:42 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:43.698006 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:43.698737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:43.706962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:43.707595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:43.708125 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:43.708966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:43.709521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:43.710040 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:43.852567 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:43.865655 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7172f94c-023e-4e45-9b26-5294c9524558 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.173541 Aug 31 04:12:43.866555 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 394/782] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:43 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:43.881093 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:43.882125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:43.889296 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:43.889794 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:43.890213 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:43.890906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:43.891446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:43.891876 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:44.051211 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:44.060191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:44.061633 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:44.062809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bd1a7dc6-f0ae-43e6-8619-0be2aef87af5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.185747 Aug 31 04:12:44.063501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 389/783] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:43 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:44.888446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:44.889207 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:44.895856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:44.896350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:44.896780 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:44.897524 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:44.898163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:44.898585 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:45.031329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:45.039685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0cb6a1e9-4fee-44bb-b6d3-b3a335541365 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1366 microversion: 2.1 time: 0.156334 Aug 31 04:12:45.040459 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 395/784] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:44 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:45.086298 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:45.087015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:45.093573 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:45.094064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:45.094494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:45.095216 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:45.095670 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:45.096094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:45.232217 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:45.241304 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:45.242724 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:45.244171 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a21e2820-5db7-4e4b-9745-e2f9998a03bb tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.161633 Aug 31 04:12:45.244734 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 390/785] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:45 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:46.066868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:46.067707 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:46.075293 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:46.075768 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:46.076376 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:46.077265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:46.077772 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:46.078348 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:46.222238 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:46.230060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a086a699-5142-4b4a-a380-88c33939b763 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1556 microversion: 2.1 time: 0.168456 Aug 31 04:12:46.230640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 396/786] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:46 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:46.251626 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:46.252707 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:46.263366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:46.263530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:46.263961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:46.269165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:46.269165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:46.269165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:46.270802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:46.271577 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:46.279319 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:46.279894 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:46.280467 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:46.281277 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:46.281889 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:46.282474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:46.433764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:46.448120 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:46.451385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:46.453511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad10676d-4e41-437b-a943-83c93136120e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.188468 Aug 31 04:12:46.467371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 397/787] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:46 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:46.527320 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-55001d28-e962-4b10-ae5f-68dd81ec902a tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.279409 Aug 31 04:12:46.528006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 391/788] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 31 04:12:46 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:12:47.476538 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:47.477114 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:47.490613 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:47.491116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:47.491712 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:47.492560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:47.493219 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:47.493807 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:47.726918 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-fdfee90d-45e9-4be6-b66e-1a888ef335c3 req-e01d9646-f3da-4425-b860-ec3db6ebc9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08130b1d-540c-4ad8-a9b6-8a8aa11f3282", "tag": "1965184b-6e71-4d67-b3a6-30287c27fc61"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:47.737537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-fdfee90d-45e9-4be6-b66e-1a888ef335c3 req-e01d9646-f3da-4425-b860-ec3db6ebc9ef service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:47.738153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-fdfee90d-45e9-4be6-b66e-1a888ef335c3 req-e01d9646-f3da-4425-b860-ec3db6ebc9ef service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:47.738832 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-fdfee90d-45e9-4be6-b66e-1a888ef335c3 req-e01d9646-f3da-4425-b860-ec3db6ebc9ef service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:47.751380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-fdfee90d-45e9-4be6-b66e-1a888ef335c3 req-e01d9646-f3da-4425-b860-ec3db6ebc9ef service nova] Creating event network-changed:1965184b-6e71-4d67-b3a6-30287c27fc61 for instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 on hv-cinder-85391 Aug 31 04:12:47.756779 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-fdfee90d-45e9-4be6-b66e-1a888ef335c3 req-e01d9646-f3da-4425-b860-ec3db6ebc9ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222877 Aug 31 04:12:47.757920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 392/789] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:47.846487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:47.856558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:47.858472 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:47.859806 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fe2ef976-53b7-4fb2-a194-1df66188f88a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.387522 Aug 31 04:12:47.860468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 398/790] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:47 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:48.552254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-5021ddcf-64d3-4f85-9795-dff887f9da3a req-2d3f6014-8567-48cf-938f-7e7ce2fd674c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b117348-7be9-4bab-800d-3bb55db4f771", "name": "network-vif-plugged", "status": "completed", "tag": "9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:48.562165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-5021ddcf-64d3-4f85-9795-dff887f9da3a req-2d3f6014-8567-48cf-938f-7e7ce2fd674c service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:48.562636 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-5021ddcf-64d3-4f85-9795-dff887f9da3a req-2d3f6014-8567-48cf-938f-7e7ce2fd674c service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:48.563080 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-5021ddcf-64d3-4f85-9795-dff887f9da3a req-2d3f6014-8567-48cf-938f-7e7ce2fd674c service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:48.574718 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-5021ddcf-64d3-4f85-9795-dff887f9da3a req-2d3f6014-8567-48cf-938f-7e7ce2fd674c service nova] Creating event network-vif-plugged:9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1 for instance 0b117348-7be9-4bab-800d-3bb55db4f771 on hv-cinder-85391 Aug 31 04:12:48.580098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-5021ddcf-64d3-4f85-9795-dff887f9da3a req-2d3f6014-8567-48cf-938f-7e7ce2fd674c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032275 Aug 31 04:12:48.580862 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 393/791] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:48.883857 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:48.885229 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:48.892276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:48.892764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:48.893217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:48.893917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:48.894364 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:48.894785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:49.030286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:49.038612 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:49.040616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:49.041666 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-44a9950d-bc62-44c7-b147-294959fed374 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.162125 Aug 31 04:12:49.042237 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 399/792] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:48 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:49.646956 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-545718761", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "networks": [{"uuid": "3608d9e2-f4ed-4aa1-9f6d-1e20f3bf2d60"}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:49.702980 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] validate_networks() for [('3608d9e2-f4ed-4aa1-9f6d-1e20f3bf2d60', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:12:50.064865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:50.065472 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:50.068318 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:12:50.068889 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:12:50.069985 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:12:50.070588 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:12:50.071303 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:12:50.072619 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:50.073103 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:50.073533 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:50.074223 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:50.074839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:50.075284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:50.083018 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:50.083606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:50.084030 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:50.084949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:50.085403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:50.085940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:50.108513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Getting quotas for project 175f95fba7384b58b9c75ea11c6e3469. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:12:50.112725 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Getting quotas for user 06b6013a9d5044d1bb2d033a95c55a09 and project 175f95fba7384b58b9c75ea11c6e3469. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:12:50.126449 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:12:50.128450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:12:50.183151 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-321290d0-5662-4036-9e0d-994d66ae28ba tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540745 Aug 31 04:12:50.184045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 394/793] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:12:50.195816 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-fddb4247-50c5-43ce-a730-b72f3cbb6e43 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:50.197282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-fddb4247-50c5-43ce-a730-b72f3cbb6e43 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:50.231814 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:50.254403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:50.256310 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:50.262765 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6c215cd1-b3ea-4d53-a20d-225bcd0d6638 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1730 microversion: 2.20 time: 0.197275 Aug 31 04:12:50.268127 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-fddb4247-50c5-43ce-a730-b72f3cbb6e43 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:50.268652 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 400/794] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:50 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 04:12:50.282113 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-fddb4247-50c5-43ce-a730-b72f3cbb6e43 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1213 microversion: 2.1 time: 0.090352 Aug 31 04:12:50.283076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 395/795] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:50 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:51.291376 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:51.292008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:51.299921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:51.300414 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:51.300843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:51.301803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:51.302203 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:51.302616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:51.303863 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:51.305113 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:51.312096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:51.312579 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:51.313226 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:51.314153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:51.314633 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:51.315079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:51.416523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:51.424808 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ea12dc42-9a73-4c57-bb55-ecb03758077f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1265 microversion: 2.1 time: 0.124912 Aug 31 04:12:51.438207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 396/796] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:51 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:51.566369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:51.574807 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:51.576270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:51.577435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cbaf9d0a-42fc-432e-8f71-554c2701de34 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1717 microversion: 2.20 time: 0.290205 Aug 31 04:12:51.577974 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 401/797] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:12:51 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1717 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:12:52.446045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:52.446824 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:52.453460 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:52.453944 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:52.454371 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:52.455079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:52.455586 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:52.456034 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:52.654914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:52.662815 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c7f787b3-8930-4963-881d-363fe72c66f6 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1313 microversion: 2.1 time: 0.220753 Aug 31 04:12:52.663399 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 397/798] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:52 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:52.839137 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-0ceb2eaf-c8b7-495f-a075-8d5857dcbb1b req-d720e044-8968-49ce-be86-c169d5cf3bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed90518f-0882-4875-a7cb-81df2aff4e05", "tag": "53aa0b81-16e7-4a1d-a509-d7bc6af66803"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:52.852343 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0ceb2eaf-c8b7-495f-a075-8d5857dcbb1b req-d720e044-8968-49ce-be86-c169d5cf3bee service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:52.853708 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0ceb2eaf-c8b7-495f-a075-8d5857dcbb1b req-d720e044-8968-49ce-be86-c169d5cf3bee service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:52.854277 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0ceb2eaf-c8b7-495f-a075-8d5857dcbb1b req-d720e044-8968-49ce-be86-c169d5cf3bee service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:52.872265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-0ceb2eaf-c8b7-495f-a075-8d5857dcbb1b req-d720e044-8968-49ce-be86-c169d5cf3bee service nova] Creating event network-changed:53aa0b81-16e7-4a1d-a509-d7bc6af66803 for instance ed90518f-0882-4875-a7cb-81df2aff4e05 on hv-cinder-85391 Aug 31 04:12:52.877839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-0ceb2eaf-c8b7-495f-a075-8d5857dcbb1b req-d720e044-8968-49ce-be86-c169d5cf3bee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042226 Aug 31 04:12:52.878456 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 402/799] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:53.685583 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:53.686342 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:53.695241 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:53.696163 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:53.696800 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:53.697721 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:53.698319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:53.698884 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:53.849924 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:53.858231 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-564b691d-6766-4d2a-b342-5d6ea27e0cd4 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1313 microversion: 2.1 time: 0.178228 Aug 31 04:12:53.858785 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 398/800] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:53 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:54.880452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:54.881790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:54.889404 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:54.890060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:54.890517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:54.891246 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:54.891676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:54.892086 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:55.028246 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:55.036269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-753bcd32-925e-4c81-8aaf-c906054e8ada tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1313 microversion: 2.1 time: 0.160166 Aug 31 04:12:55.036847 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 403/801] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:54 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:56.057036 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:56.057632 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:56.064626 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:56.065114 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:56.065545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:56.066241 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:56.066686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:56.067157 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:56.198955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:56.202650 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=100 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:56.207471 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-970430a4-19f0-4c60-8a5c-8210df5d1775 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1313 microversion: 2.1 time: 0.154444 Aug 31 04:12:56.208021 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 399/802] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:56 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:57.231727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:57.232763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:57.239304 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:57.239809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:57.240239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:57.240925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:57.241367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:57.241787 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:57.385678 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:57.393757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b54912ce-2c5d-4916-b54e-82794e314d4d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1313 microversion: 2.1 time: 0.167509 Aug 31 04:12:57.394330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 404/803] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:57 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:58.382927 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-aa6cefeb-b25d-41fb-9b9c-3240cd6a53b1 req-4efe01a7-43d5-4c33-a3d2-8c8937ce3ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed90518f-0882-4875-a7cb-81df2aff4e05", "name": "network-vif-plugged", "status": "completed", "tag": "53aa0b81-16e7-4a1d-a509-d7bc6af66803"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:12:58.395847 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-aa6cefeb-b25d-41fb-9b9c-3240cd6a53b1 req-4efe01a7-43d5-4c33-a3d2-8c8937ce3ed2 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:58.396512 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-aa6cefeb-b25d-41fb-9b9c-3240cd6a53b1 req-4efe01a7-43d5-4c33-a3d2-8c8937ce3ed2 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:58.396944 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-aa6cefeb-b25d-41fb-9b9c-3240cd6a53b1 req-4efe01a7-43d5-4c33-a3d2-8c8937ce3ed2 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:58.408806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-aa6cefeb-b25d-41fb-9b9c-3240cd6a53b1 req-4efe01a7-43d5-4c33-a3d2-8c8937ce3ed2 service nova] Creating event network-vif-plugged:53aa0b81-16e7-4a1d-a509-d7bc6af66803 for instance ed90518f-0882-4875-a7cb-81df2aff4e05 on hv-cinder-85391 Aug 31 04:12:58.413750 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-aa6cefeb-b25d-41fb-9b9c-3240cd6a53b1 req-4efe01a7-43d5-4c33-a3d2-8c8937ce3ed2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034544 Aug 31 04:12:58.414470 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 400/804] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:12:58.414946 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:58.415800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:58.422815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:58.423488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:58.423925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:58.424638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:58.425094 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:58.425517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:58.573932 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:58.581780 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2d3267a9-e46b-4631-9b31-639158692574 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1313 microversion: 2.1 time: 0.171671 Aug 31 04:12:58.582357 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 405/805] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:58 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:12:59.661977 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:12:59.662643 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:12:59.669819 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:59.670301 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:59.670770 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:59.671506 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:12:59.671948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:12:59.672359 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:12:59.802854 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:12:59.811271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-02f7e2db-f2e7-42cb-bf0c-345d9e6b22e3 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1313 microversion: 2.1 time: 0.153611 Aug 31 04:12:59.811803 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 401/806] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:12:59 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:00.835972 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:00.837611 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:00.841328 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:00.850071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:00.850949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:00.852006 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:00.852818 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:00.853278 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:00.853696 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:00.998959 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:01.008253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-308314ab-e9e7-4a98-967e-69280a2c4303 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1498 microversion: 2.1 time: 0.178748 Aug 31 04:13:01.009066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 406/807] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:00 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1498 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:01.445952 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:01.446632 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:01.448648 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:01.449364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=8 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:01.456056 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:01.456546 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:01.456978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:01.457678 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:01.458131 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:01.458554 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:01.486345 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:13:01.551944 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:01.569829 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ae543206-9c48-45b9-8e7b-755938faae2d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 204 len: 0 microversion: 2.1 time: 0.127686 Aug 31 04:13:01.570581 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 402/808] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:13:01 2022] DELETE /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:13:01.580260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:01.580881 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:01.587174 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:01.587682 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:01.588112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:01.588800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:01.589256 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:01.589688 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:01.720474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:01.730919 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-53231f35-2782-4e8b-a867-5563e3b6890c tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1504 microversion: 2.1 time: 0.154946 Aug 31 04:13:01.731534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 407/809] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:01 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:02.757721 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:02.758953 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:02.769596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:02.770391 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:02.771119 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:02.772272 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:02.773036 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:02.773867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:02.910781 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:02.919347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1643ba7d-24c1-4e9a-9c7a-f7e6d08b8e9f tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1504 microversion: 2.1 time: 0.168488 Aug 31 04:13:02.919912 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 403/810] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:02 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:03.501309 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-b246d21e-9281-4294-b1df-9729de1a8e94 req-274842bf-2e6d-4cfb-977a-bc9371e3680b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed90518f-0882-4875-a7cb-81df2aff4e05", "name": "network-vif-deleted", "tag": "53aa0b81-16e7-4a1d-a509-d7bc6af66803"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:03.511896 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b246d21e-9281-4294-b1df-9729de1a8e94 req-274842bf-2e6d-4cfb-977a-bc9371e3680b service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:03.512471 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b246d21e-9281-4294-b1df-9729de1a8e94 req-274842bf-2e6d-4cfb-977a-bc9371e3680b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:03.512940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b246d21e-9281-4294-b1df-9729de1a8e94 req-274842bf-2e6d-4cfb-977a-bc9371e3680b service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:03.525026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-b246d21e-9281-4294-b1df-9729de1a8e94 req-274842bf-2e6d-4cfb-977a-bc9371e3680b service nova] Creating event network-vif-deleted:53aa0b81-16e7-4a1d-a509-d7bc6af66803 for instance ed90518f-0882-4875-a7cb-81df2aff4e05 on hv-cinder-85391 Aug 31 04:13:03.530262 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-b246d21e-9281-4294-b1df-9729de1a8e94 req-274842bf-2e6d-4cfb-977a-bc9371e3680b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 Aug 31 04:13:03.530913 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 408/811] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:03.951207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:03.952188 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:03.962937 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:03.963794 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:03.964509 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:03.965629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:03.966373 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:03.967092 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:04.002599 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:04.003061 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:04.003509 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:04.003937 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lazy-loading 'fault' on Instance uuid ed90518f-0882-4875-a7cb-81df2aff4e05 {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:13:04.047751 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:04.059316 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c51e808f-095f-4837-876f-2917d02f1584 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 200 len: 1303 microversion: 2.1 time: 0.114634 Aug 31 04:13:04.059940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 404/812] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:03 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:05.086904 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:05.087665 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: ed90518f-0882-4875-a7cb-81df2aff4e05] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:05.095580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:05.096113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:05.096564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:05.097280 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:05.097745 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:05.098310 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:05.113040 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] HTTP exception thrown: Instance ed90518f-0882-4875-a7cb-81df2aff4e05 could not be found. Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Request method failure captured: Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 HTTP/1.1 Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt-_R24QSm9VL4YhZF7FCZspPnktMHb0aWRBehTl6rQaVOwOOSLhMmFxXB6928B7uMQYAej9heCgsGAP9gouL0N6ssOJ7BwXcuYQywsLfVo4RDn6i72dl1xS8I08gzroGOLlDD4AH1s_roXGJFrBN_RYcmK47IsId48N4-XqpnYJCuI Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 175f95fba7384b58b9c75ea11c6e3469 Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesActionsTest-140566636 Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:05.114726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/175f95fba7384b58b9c75ea11c6e3469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/175f95fba7384b58b9c75ea11c6e3469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/175f95fba7384b58b9c75ea11c6e3469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_175f95fba7384b58b9c75ea11c6e3469", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesActionsTest-140566636 Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 175f95fba7384b58b9c75ea11c6e3469 Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesActionsTest-140566636 Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesActionsTest-140566636-project Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 06b6013a9d5044d1bb2d033a95c55a09 Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesActionsTest-140566636-project Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance ed90518f-0882-4875-a7cb-81df2aff4e05 could not be found. Aug 31 04:13:05.116435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'ed90518f-0882-4875-a7cb-81df2aff4e05'} Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed90518f-0882-4875-a7cb-81df2aff4e05 could not be found. Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:05.117506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed90518f-0882-4875-a7cb-81df2aff4e05 could not be found. Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed90518f-0882-4875-a7cb-81df2aff4e05 could not be found. Aug 31 04:13:05.118823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:05.120065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Returning 404 to user: Instance ed90518f-0882-4875-a7cb-81df2aff4e05 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:05.120065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6be8741d-d088-471b-9f5d-aa45abe1d633 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05" status: 404 len: 111 microversion: 2.1 time: 0.036993 Aug 31 04:13:05.120065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 409/813] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:05 2022] GET /compute/v2.1/servers/ed90518f-0882-4875-a7cb-81df2aff4e05 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:05.167981 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1690555645", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "networks": [{"uuid": "3608d9e2-f4ed-4aa1-9f6d-1e20f3bf2d60"}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:05.222295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] validate_networks() for [('3608d9e2-f4ed-4aa1-9f6d-1e20f3bf2d60', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:13:05.599394 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:13:05.599817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:13:05.600290 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:13:05.600694 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:13:05.601104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:13:05.610735 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:05.611290 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:05.611730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:05.612450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:05.612905 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:05.613325 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:05.630239 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Getting quotas for project 175f95fba7384b58b9c75ea11c6e3469. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:13:05.634247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Getting quotas for user 06b6013a9d5044d1bb2d033a95c55a09 and project 175f95fba7384b58b9c75ea11c6e3469. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:13:05.645596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:13:05.647921 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:13:05.693647 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-93aa494b-dd83-4dfa-82df-2f76b06c7d66 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529609 Aug 31 04:13:05.694264 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 405/814] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:13:05.706047 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-aaa726e0-81b4-4b92-ab88-6069100fefa1 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:05.706663 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-aaa726e0-81b4-4b92-ab88-6069100fefa1 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:05.769023 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-aaa726e0-81b4-4b92-ab88-6069100fefa1 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:05.776022 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-aaa726e0-81b4-4b92-ab88-6069100fefa1 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1214 microversion: 2.1 time: 0.074049 Aug 31 04:13:05.776693 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 410/815] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:05 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:06.796908 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:06.797548 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:06.807705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:06.808197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:06.808910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:06.810073 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:06.810536 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:06.810996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:06.903511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:06.912555 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6cf07f47-dfd8-4886-b009-15b6b928a559 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1274 microversion: 2.1 time: 0.120227 Aug 31 04:13:06.913359 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 406/816] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:06 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:07.933906 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:07.934610 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:07.942242 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:07.942820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:07.943289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:07.943993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:07.944449 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:07.944872 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:07.949309 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:08.162922 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:08.172328 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-845e209d-b7a6-45a9-b481-21ac220122f5 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1314 microversion: 2.1 time: 0.242552 Aug 31 04:13:08.172881 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 411/817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:07 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:08.267614 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-713bab11-fed2-431e-8c9b-78dc5d43769d req-a673fa29-38d3-47aa-97ba-41ceb5097e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc56ebee-4e59-44c5-9f90-eecbb546130a", "tag": "4c3f7093-b410-4b86-b3e5-7f64d970ebc5"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:08.280762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-713bab11-fed2-431e-8c9b-78dc5d43769d req-a673fa29-38d3-47aa-97ba-41ceb5097e05 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:08.281246 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-713bab11-fed2-431e-8c9b-78dc5d43769d req-a673fa29-38d3-47aa-97ba-41ceb5097e05 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:08.281682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-713bab11-fed2-431e-8c9b-78dc5d43769d req-a673fa29-38d3-47aa-97ba-41ceb5097e05 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:08.294805 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-713bab11-fed2-431e-8c9b-78dc5d43769d req-a673fa29-38d3-47aa-97ba-41ceb5097e05 service nova] Creating event network-changed:4c3f7093-b410-4b86-b3e5-7f64d970ebc5 for instance dc56ebee-4e59-44c5-9f90-eecbb546130a on hv-cinder-85391 Aug 31 04:13:08.299598 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-713bab11-fed2-431e-8c9b-78dc5d43769d req-a673fa29-38d3-47aa-97ba-41ceb5097e05 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036568 Aug 31 04:13:08.300570 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 407/818] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:09.198495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:09.199389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:09.209536 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:09.210274 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:09.210915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:09.212040 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:09.212736 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:09.213380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:09.359129 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:09.367345 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f750dc87-c787-4dba-bf37-85f96bd4aeea tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1314 microversion: 2.1 time: 0.174729 Aug 31 04:13:09.367910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 412/819] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:09 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:10.391740 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:10.392676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:10.400940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:10.401453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:10.401886 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:10.402581 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:10.403014 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:10.403466 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:10.541545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:10.549525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6973e2d2-501c-42f5-bef7-655f8d2ea3da tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1314 microversion: 2.1 time: 0.164956 Aug 31 04:13:10.550092 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 408/820] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:10 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:11.570819 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:11.571515 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:11.581837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:11.582487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:11.583090 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:11.584057 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:11.584578 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:11.585187 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:11.724858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:11.733081 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9e47fa63-e453-4292-bc8f-5aaf18aa08bd tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1314 microversion: 2.1 time: 0.166577 Aug 31 04:13:11.733651 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 413/821] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:11 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:12.299295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-0e0151db-bced-4788-8e32-568a0951f91d req-6d1fd560-1950-4bc6-bd0b-a1498145ba4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc56ebee-4e59-44c5-9f90-eecbb546130a", "name": "network-vif-plugged", "status": "completed", "tag": "4c3f7093-b410-4b86-b3e5-7f64d970ebc5"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:12.309627 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-0e0151db-bced-4788-8e32-568a0951f91d req-6d1fd560-1950-4bc6-bd0b-a1498145ba4a service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:12.310125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-0e0151db-bced-4788-8e32-568a0951f91d req-6d1fd560-1950-4bc6-bd0b-a1498145ba4a service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:12.310554 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-0e0151db-bced-4788-8e32-568a0951f91d req-6d1fd560-1950-4bc6-bd0b-a1498145ba4a service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:12.322096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-0e0151db-bced-4788-8e32-568a0951f91d req-6d1fd560-1950-4bc6-bd0b-a1498145ba4a service nova] Creating event network-vif-plugged:4c3f7093-b410-4b86-b3e5-7f64d970ebc5 for instance dc56ebee-4e59-44c5-9f90-eecbb546130a on hv-cinder-85391 Aug 31 04:13:12.327117 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-0e0151db-bced-4788-8e32-568a0951f91d req-6d1fd560-1950-4bc6-bd0b-a1498145ba4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031586 Aug 31 04:13:12.327754 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 409/822] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:12.757216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:12.758548 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:12.765633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:12.766143 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:12.766577 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:12.767308 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:12.767795 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:12.768222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:12.906998 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:12.917481 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0b35236a-1c87-46e5-8fcf-c51ef6fa7a51 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1314 microversion: 2.1 time: 0.167015 Aug 31 04:13:12.918046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 414/823] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:12 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:13.941735 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:13.942616 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:13.951716 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:13.952361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:13.952940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:13.953850 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:13.954450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:13.955016 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:14.094631 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:14.103152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-12946634-c083-4857-9550-1dddd0af1187 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1314 microversion: 2.1 time: 0.167680 Aug 31 04:13:14.103722 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 410/824] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:13 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:15.128143 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:15.129090 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:15.137406 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:15.137891 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:15.138320 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:15.139014 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:15.139491 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:15.139912 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:15.278141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:15.286732 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-718caf4c-305e-4b48-b684-43e3733c8536 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1499 microversion: 2.1 time: 0.165035 Aug 31 04:13:15.287773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 415/825] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:15 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:15.777839 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:15.778397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:15.780987 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:15.781618 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=6 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:15.787789 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:15.788282 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:15.788789 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:15.789550 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:15.790007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:15.790432 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:15.816146 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:13:15.896885 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1f3ec34d-7904-4dee-9be6-cd4249fba33d tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 204 len: 0 microversion: 2.1 time: 0.122926 Aug 31 04:13:15.897804 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 411/826] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:13:15 2022] DELETE /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:13:15.906885 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:15.907618 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:15.909908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:15.915633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:15.916121 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:15.916552 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:15.917243 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:15.917691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:15.918107 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:16.063691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:16.071863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-584c0f62-de6d-4d6f-8295-83652e2f97ce tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1505 microversion: 2.1 time: 0.169441 Aug 31 04:13:16.072445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 416/827] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:15 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:17.093490 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:17.094313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:17.102496 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:17.102960 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:17.103430 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:17.104144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:17.104598 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:17.105022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:17.247710 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:17.258732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-35c77c01-fd99-4f26-9187-7f0dd02dcde2 tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1505 microversion: 2.1 time: 0.169466 Aug 31 04:13:17.259345 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 412/828] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:17 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:18.135649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-b55e3c8a-67f0-40e4-bf03-acae939efa9a req-d70d7008-faf3-4b09-b83a-9c20e4a01004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc56ebee-4e59-44c5-9f90-eecbb546130a", "name": "network-vif-deleted", "tag": "4c3f7093-b410-4b86-b3e5-7f64d970ebc5"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:18.145602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b55e3c8a-67f0-40e4-bf03-acae939efa9a req-d70d7008-faf3-4b09-b83a-9c20e4a01004 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:18.146128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b55e3c8a-67f0-40e4-bf03-acae939efa9a req-d70d7008-faf3-4b09-b83a-9c20e4a01004 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:18.146750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b55e3c8a-67f0-40e4-bf03-acae939efa9a req-d70d7008-faf3-4b09-b83a-9c20e4a01004 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:18.158950 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-b55e3c8a-67f0-40e4-bf03-acae939efa9a req-d70d7008-faf3-4b09-b83a-9c20e4a01004 service nova] Creating event network-vif-deleted:4c3f7093-b410-4b86-b3e5-7f64d970ebc5 for instance dc56ebee-4e59-44c5-9f90-eecbb546130a on hv-cinder-85391 Aug 31 04:13:18.164947 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-b55e3c8a-67f0-40e4-bf03-acae939efa9a req-d70d7008-faf3-4b09-b83a-9c20e4a01004 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032813 Aug 31 04:13:18.165790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 417/829] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:18.279263 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:18.279906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:18.286715 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:18.287257 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:18.288285 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:18.288406 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:18.288827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:18.289966 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:18.322045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:18.322498 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:18.322996 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:18.323742 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.objects.instance [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lazy-loading 'fault' on Instance uuid dc56ebee-4e59-44c5-9f90-eecbb546130a {{(pid=120661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:13:18.364721 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b6013a9d5044d1bb2d033a95c55a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175f95fba7384b58b9c75ea11c6e3469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:18.373468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7537e52d-1440-4f35-ba8a-5bcea6cbfedf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 200 len: 1304 microversion: 2.1 time: 0.097997 Aug 31 04:13:18.374027 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 413/830] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:18 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:19.401099 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:19.402268 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] [instance: dc56ebee-4e59-44c5-9f90-eecbb546130a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:19.412651 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:19.413456 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:19.414165 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:19.415294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:19.415713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:19.416146 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:19.429707 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] HTTP exception thrown: Instance dc56ebee-4e59-44c5-9f90-eecbb546130a could not be found. Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Request method failure captured: Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a HTTP/1.1 Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt-_R24QSm9VL4YhZF7FCZspPnktMHb0aWRBehTl6rQaVOwOOSLhMmFxXB6928B7uMQYAej9heCgsGAP9gouL0N6ssOJ7BwXcuYQywsLfVo4RDn6i72dl1xS8I08gzroGOLlDD4AH1s_roXGJFrBN_RYcmK47IsId48N4-XqpnYJCuI Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 175f95fba7384b58b9c75ea11c6e3469 Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesActionsTest-140566636 Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:19.431389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/175f95fba7384b58b9c75ea11c6e3469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/175f95fba7384b58b9c75ea11c6e3469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/175f95fba7384b58b9c75ea11c6e3469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_175f95fba7384b58b9c75ea11c6e3469", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesActionsTest-140566636 Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 175f95fba7384b58b9c75ea11c6e3469 Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesActionsTest-140566636 Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesActionsTest-140566636-project Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 06b6013a9d5044d1bb2d033a95c55a09 Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesActionsTest-140566636-project Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance dc56ebee-4e59-44c5-9f90-eecbb546130a could not be found. Aug 31 04:13:19.432809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'dc56ebee-4e59-44c5-9f90-eecbb546130a'} Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc56ebee-4e59-44c5-9f90-eecbb546130a could not be found. Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:19.433695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc56ebee-4e59-44c5-9f90-eecbb546130a could not be found. Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc56ebee-4e59-44c5-9f90-eecbb546130a could not be found. Aug 31 04:13:19.435314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:19.436694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] Returning 404 to user: Instance dc56ebee-4e59-44c5-9f90-eecbb546130a could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:19.436694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-16ae9497-c5eb-4c7a-92e5-afdeb35436cf tempest-VolumesActionsTest-140566636 tempest-VolumesActionsTest-140566636-project] 10.222.0.18 "GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a" status: 404 len: 111 microversion: 2.1 time: 0.039819 Aug 31 04:13:19.436694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 418/831] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:19 2022] GET /compute/v2.1/servers/dc56ebee-4e59-44c5-9f90-eecbb546130a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:24.220704 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:24.222086 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:24.229281 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:24.229873 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:24.230558 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:24.231295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:24.232315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:24.233021 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:24.259435 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ee483d8d-1005-4a92-9da5-634990844c0c tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/ips" status: 200 len: 149 microversion: 2.1 time: 0.043486 Aug 31 04:13:24.261256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 414/832] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:13:24 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:25.153146 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:25.155527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:25.163362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:25.163824 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:25.164262 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:25.165223 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:25.165908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:25.166441 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:25.209564 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7767327d-d729-43a2-b409-eacff8969613 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060587 Aug 31 04:13:25.211263 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 419/833] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 31 04:13:25 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:25.309384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:25.310140 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:25.317480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:25.317967 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:25.318409 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:25.319152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:25.319606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:25.320024 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:25.345394 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:25.355907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:13:25.445949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4d37884b-7ddc-4be8-b766-cf77437020b5 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 204 len: 0 microversion: 2.20 time: 0.141252 Aug 31 04:13:25.450006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 415/834] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 31 04:13:25 2022] DELETE /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 04:13:25.456604 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:25.457304 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:25.469071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:25.470164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:25.470594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:25.471352 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:25.472558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:25.473319 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:25.624956 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:25.637629 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:25.639234 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:25.640914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0dc83497-beff-4071-8931-0ec7ac943323 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.189157 Aug 31 04:13:25.641575 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 420/835] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:13:25 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:13:25.705318 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0689a99-8e3b-4e5f-bc60-0cf3aaa9dd34"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:25.708276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:25.715380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:25.715861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:25.716284 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:25.717044 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:25.717497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:25.717906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:26.665191 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:26.666147 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:26.673708 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:26.674217 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:26.674648 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:26.675685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:26.676358 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:26.676989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:26.859214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:26.868297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:26.869964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:26.872892 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b401685b-07b5-49f7-958d-e3f89046e4af tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1723 microversion: 2.20 time: 0.210312 Aug 31 04:13:26.873568 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 421/836] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:13:26 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:13:26.950816 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-65c4154c-7635-4cfb-afb8-b657174fd781 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "POST /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.249905 Aug 31 04:13:26.952546 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 416/837] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:13:25 2022] POST /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-volume_attachments => generated 194 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:27.897765 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:27.899092 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:27.906650 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:27.907431 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:27.908086 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:27.909034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:27.909532 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:27.910149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:27.993632 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:28.012255 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:28.020044 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '956b08da3ba944d382877cf266389127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bcbde4eda6417ea15dca2371c28540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:28.022994 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9347534d-304f-460e-81d6-ce02b03e1622 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 200 len: 1656 microversion: 2.20 time: 0.127567 Aug 31 04:13:28.023722 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 422/838] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:13:27 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 1656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 04:13:28.048083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-29630385-1a0d-4e48-9596-805c8c412cdf req-0dc23e56-be07-49c0-9129-352e13afc912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b117348-7be9-4bab-800d-3bb55db4f771", "name": "network-vif-deleted", "tag": "9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:28.076913 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-29630385-1a0d-4e48-9596-805c8c412cdf req-0dc23e56-be07-49c0-9129-352e13afc912 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:28.078746 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-29630385-1a0d-4e48-9596-805c8c412cdf req-0dc23e56-be07-49c0-9129-352e13afc912 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:28.079247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-29630385-1a0d-4e48-9596-805c8c412cdf req-0dc23e56-be07-49c0-9129-352e13afc912 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:28.114247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-29630385-1a0d-4e48-9596-805c8c412cdf req-0dc23e56-be07-49c0-9129-352e13afc912 service nova] Creating event network-vif-deleted:9473ec1c-d1ec-4c4a-a77a-794a55f5d8b1 for instance 0b117348-7be9-4bab-800d-3bb55db4f771 on hv-cinder-85391 Aug 31 04:13:28.128102 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-29630385-1a0d-4e48-9596-805c8c412cdf req-0dc23e56-be07-49c0-9129-352e13afc912 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084760 Aug 31 04:13:28.130288 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 417/839] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:13:29.048062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:29.048598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:29.057142 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:29.058021 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:29.058470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:29.059227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:29.059747 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:29.060179 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:29.078253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] HTTP exception thrown: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Request method failure captured: Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 HTTP/1.1 Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5Eg6KYMxJKbjLzrbyTkF9vp9WlR6XPV_ugaUyY2uP-JiDy-FrTE_lg-OwfDmpoEs9s2H0HUmvxgsxHjVVF2GjRcgJZEzO29MtEQ7yWhYwnn5LFGtSk6g4mQE0jz-9G4NHtpsSkInh8xGuJqc7WVxCnlY2ctNeukZY7xyuFgww1nbc Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:29.079843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66bcbde4eda6417ea15dca2371c28540", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 956b08da3ba944d382877cf266389127 Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:29.081500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '0b117348-7be9-4bab-800d-3bb55db4f771'} Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:29.082407 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:29.083898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:29.085864 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Returning 404 to user: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:29.086751 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d2bd15a3-f273-407a-852f-9584c9e15d4e tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 404 len: 111 microversion: 2.20 time: 0.044669 Aug 31 04:13:29.087385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 423/840] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:13:29 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:13:29.096547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3c8337dd-697d-4792-bd6b-c71a66e9bc0a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '.version_select at 0x7f88ad1c2d30>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:29.119412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3c8337dd-697d-4792-bd6b-c71a66e9bc0a tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302895557" status: 204 len: 0 microversion: 2.20 time: 0.026948 Aug 31 04:13:29.120195 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 418/841] 10.222.0.18 () {60 vars in 1259 bytes} [Wed Aug 31 04:13:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302895557 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 04:13:31.170997 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:31.172265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:31.179757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=38 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:31.183055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:31.183795 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:31.184420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:31.185468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:31.185926 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:31.186356 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:31.203717 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] HTTP exception thrown: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Request method failure captured: Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 HTTP/1.1 Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5Eg6KYMxJKbjLzrbyTkF9vp9WlR6XPV_ugaUyY2uP-JiDy-FrTE_lg-OwfDmpoEs9s2H0HUmvxgsxHjVVF2GjRcgJZEzO29MtEQ7yWhYwnn5LFGtSk6g4mQE0jz-9G4NHtpsSkInh8xGuJqc7WVxCnlY2ctNeukZY7xyuFgww1nbc Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:31.205779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66bcbde4eda6417ea15dca2371c28540", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 956b08da3ba944d382877cf266389127 Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.207729 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '0b117348-7be9-4bab-800d-3bb55db4f771'} Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:31.208750 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.210378 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.212034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Returning 404 to user: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:31.212034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a2d04a29-eaa6-4aa4-a8f3-0cac1451736d tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 404 len: 111 microversion: 2.20 time: 0.041332 Aug 31 04:13:31.212034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 424/842] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 31 04:13:31 2022] DELETE /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:13:31.217459 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:31.218299 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 0b117348-7be9-4bab-800d-3bb55db4f771] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:31.226138 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:31.226681 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:31.227201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:31.227976 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:31.228660 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:31.229247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:31.247642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] HTTP exception thrown: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Request method failure captured: Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 HTTP/1.1 Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5Eg6KYMxJKbjLzrbyTkF9vp9WlR6XPV_ugaUyY2uP-JiDy-FrTE_lg-OwfDmpoEs9s2H0HUmvxgsxHjVVF2GjRcgJZEzO29MtEQ7yWhYwnn5LFGtSk6g4mQE0jz-9G4NHtpsSkInh8xGuJqc7WVxCnlY2ctNeukZY7xyuFgww1nbc Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:13:31.249400 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66bcbde4eda6417ea15dca2371c28540", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 956b08da3ba944d382877cf266389127 Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.251165 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '0b117348-7be9-4bab-800d-3bb55db4f771'} Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:31.252038 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. Aug 31 04:13:31.253502 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:31.254740 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Returning 404 to user: Instance 0b117348-7be9-4bab-800d-3bb55db4f771 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:31.254740 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-74b77d0e-d751-40fc-a7ef-2b6d1d371ca9 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771" status: 404 len: 111 microversion: 2.20 time: 0.037827 Aug 31 04:13:31.254740 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 419/843] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:13:31 2022] GET /compute/v2.1/servers/0b117348-7be9-4bab-800d-3bb55db4f771 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:13:32.445871 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:32.447164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:32.454688 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:32.455214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:32.455640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:32.456351 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:32.456800 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:32.457208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:32.471796 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] HTTP exception thrown: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Request method failure captured: Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 HTTP/1.1 Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5Eg6KYMxJKbjLzrbyTkF9vp9WlR6XPV_ugaUyY2uP-JiDy-FrTE_lg-OwfDmpoEs9s2H0HUmvxgsxHjVVF2GjRcgJZEzO29MtEQ7yWhYwnn5LFGtSk6g4mQE0jz-9G4NHtpsSkInh8xGuJqc7WVxCnlY2ctNeukZY7xyuFgww1nbc Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:32.473367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66bcbde4eda6417ea15dca2371c28540", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 956b08da3ba944d382877cf266389127 Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.475101 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '675abe1e-ac1e-458b-b5ac-745a7f6917b7'} Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:32.475989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.477457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.479653 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Returning 404 to user: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:32.480773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-569606cd-85b5-483e-a577-3e2c5d11055f tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "DELETE /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 404 len: 111 microversion: 2.20 time: 0.039441 Aug 31 04:13:32.481688 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 425/844] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 31 04:13:32 2022] DELETE /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:13:32.492698 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:32.493426 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] [instance: 675abe1e-ac1e-458b-b5ac-745a7f6917b7] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:32.498949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:32.502820 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:32.503331 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:32.503765 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:32.504505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:32.505034 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:32.505646 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:32.532098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] HTTP exception thrown: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Request method failure captured: Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 HTTP/1.1 Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5Eg6KYMxJKbjLzrbyTkF9vp9WlR6XPV_ugaUyY2uP-JiDy-FrTE_lg-OwfDmpoEs9s2H0HUmvxgsxHjVVF2GjRcgJZEzO29MtEQ7yWhYwnn5LFGtSk6g4mQE0jz-9G4NHtpsSkInh8xGuJqc7WVxCnlY2ctNeukZY7xyuFgww1nbc Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:13:32.534713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66bcbde4eda6417ea15dca2371c28540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66bcbde4eda6417ea15dca2371c28540", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: 66bcbde4eda6417ea15dca2371c28540 Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-287211119 Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 956b08da3ba944d382877cf266389127 Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-287211119-project Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.536276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '675abe1e-ac1e-458b-b5ac-745a7f6917b7'} Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:32.537096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. Aug 31 04:13:32.538351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:32.539594 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] Returning 404 to user: Instance 675abe1e-ac1e-458b-b5ac-745a7f6917b7 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:32.539594 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d1c4f394-4915-4252-af26-51a24ddf0a20 tempest-AttachVolumeShelveTestJSON-287211119 tempest-AttachVolumeShelveTestJSON-287211119-project] 10.222.0.18 "GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7" status: 404 len: 111 microversion: 2.20 time: 0.050241 Aug 31 04:13:32.539594 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 420/845] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 31 04:13:32 2022] GET /compute/v2.1/servers/675abe1e-ac1e-458b-b5ac-745a7f6917b7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 04:13:33.733069 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:33.733643 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:33.752006 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:33.752510 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:33.752969 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:33.753684 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:33.754132 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:33.755366 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:33.878539 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lazy-loading 'services' on Instance uuid 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:13:34.012803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9942e42c-3a81-4d6d-80ba-72346a7e1aa1 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-volume_attachments/c0689a99-8e3b-4e5f-bc60-0cf3aaa9dd34" status: 202 len: 0 microversion: 2.1 time: 0.283764 Aug 31 04:13:34.024533 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:34.028028 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:34.030116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 426/846] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:13:33 2022] DELETE /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-volume_attachments/c0689a99-8e3b-4e5f-bc60-0cf3aaa9dd34 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:13:34.046420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:34.049252 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:34.049868 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:34.050741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:34.051413 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:34.052008 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:34.089459 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-50ee743e-8410-45b9-bbcb-11a83f225b9d tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069443 Aug 31 04:13:34.094476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 421/847] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:13:34 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:35.105120 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:35.115426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:35.146997 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:35.147973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:35.149541 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:35.154579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:35.156311 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:35.157508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:35.237857 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-77455225-2714-4bc0-9a2e-75fdd36634d7 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137219 Aug 31 04:13:35.240524 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 427/848] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:13:35 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:13:35.309923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:35.310489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:35.319806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:35.319806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:35.319806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:35.319806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:35.320405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:35.320405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:35.370564 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:13:35.531754 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-915de5a0-d4c0-43fe-bb33-c485502f8af2 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 204 len: 0 microversion: 2.1 time: 0.224188 Aug 31 04:13:35.544036 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:35.544748 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:35.547903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 422/849] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:13:35 2022] DELETE /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:13:35.551448 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:35.552185 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:35.552813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:35.553606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:35.554141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:35.554601 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:35.783340 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:35.794173 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a6e6bfd2-6e25-4409-8c05-b0ddcf2d6690 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1680 microversion: 2.1 time: 0.254765 Aug 31 04:13:35.794776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 428/850] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:35 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:36.819191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:36.820484 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:36.836629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:36.837729 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:36.840247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:36.841421 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:36.842110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:36.842679 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:37.072462 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:37.090770 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-af6cd457-1fdd-4d5b-aa2a-8426c025c86b tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1680 microversion: 2.1 time: 0.276379 Aug 31 04:13:37.091461 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 423/851] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:36 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1680 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:38.113033 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:38.114218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:38.124553 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:38.125289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:38.126569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:38.127514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:38.128137 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:38.128715 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:38.155638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:38.238767 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80c8c1d6af7450eb8f936df231ad63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbbb020a1944de2a8fa16379f8cec7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:38.248351 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-74d8ad64-5c84-4169-8d5e-2ea87ea34de4 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 200 len: 1613 microversion: 2.1 time: 0.139196 Aug 31 04:13:38.249071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 429/852] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:38 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 1613 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:38.426024 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-24c77bce-a646-4517-becd-d6b2a4849892 req-0f79b452-5595-4f64-91b9-677f1ca03ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08130b1d-540c-4ad8-a9b6-8a8aa11f3282", "name": "network-vif-deleted", "tag": "1965184b-6e71-4d67-b3a6-30287c27fc61"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:38.449199 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-24c77bce-a646-4517-becd-d6b2a4849892 req-0f79b452-5595-4f64-91b9-677f1ca03ce3 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:38.459315 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-24c77bce-a646-4517-becd-d6b2a4849892 req-0f79b452-5595-4f64-91b9-677f1ca03ce3 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:38.460031 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-24c77bce-a646-4517-becd-d6b2a4849892 req-0f79b452-5595-4f64-91b9-677f1ca03ce3 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:38.493149 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-24c77bce-a646-4517-becd-d6b2a4849892 req-0f79b452-5595-4f64-91b9-677f1ca03ce3 service nova] Creating event network-vif-deleted:1965184b-6e71-4d67-b3a6-30287c27fc61 for instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 on hv-cinder-85391 Aug 31 04:13:38.511270 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-24c77bce-a646-4517-becd-d6b2a4849892 req-0f79b452-5595-4f64-91b9-677f1ca03ce3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088795 Aug 31 04:13:38.512423 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 424/853] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:39.279349 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:39.288334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:39.296071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:39.296874 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:39.297471 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:39.298350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:39.299098 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:39.299687 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:39.319756 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 HTTP/1.1 Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:39.323111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:39.324802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '08130b1d-540c-4ad8-a9b6-8a8aa11f3282'} Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:39.325720 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:39.327421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:39.330521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:39.332163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4fe6358c-a832-41ce-a42d-45ee40c2b16e tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 404 len: 111 microversion: 2.1 time: 0.057990 Aug 31 04:13:39.344133 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c4ebbb8f-498a-4d96-9150-e165adb807de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '.version_select at 0x7f88ad1ad8b0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:39.348260 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 430/854] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:39 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:39.379602 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c4ebbb8f-498a-4d96-9150-e165adb807de tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667769171" status: 202 len: 0 microversion: 2.1 time: 0.040393 Aug 31 04:13:39.384611 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 425/855] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 31 04:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667769171 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:13:41.519307 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:41.520334 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:41.529466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:41.530178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:41.530805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:41.531699 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:41.532335 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:41.532759 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:41.551446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 HTTP/1.1 Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:41.553204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.554537 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '08130b1d-540c-4ad8-a9b6-8a8aa11f3282'} Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:41.555898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.557323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.558508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:41.558508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ec3e3661-7392-4c74-8982-ac6b4c99ec96 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 404 len: 111 microversion: 2.1 time: 0.039955 Aug 31 04:13:41.558508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 431/856] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:13:41 2022] DELETE /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 04:13:41.569285 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:41.570033 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 08130b1d-540c-4ad8-a9b6-8a8aa11f3282] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:41.577220 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:41.577714 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:41.578615 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:41.579366 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:41.579827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:41.580254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:41.597221 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 HTTP/1.1 Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:13:41.599495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.600874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '08130b1d-540c-4ad8-a9b6-8a8aa11f3282'} Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:41.601603 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. Aug 31 04:13:41.604525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:41.605949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 08130b1d-540c-4ad8-a9b6-8a8aa11f3282 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:41.605949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b0afaf14-713a-4e1e-b95b-b5c3966c9760 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282" status: 404 len: 111 microversion: 2.1 time: 0.036936 Aug 31 04:13:41.605949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 426/857] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:41 2022] GET /compute/v2.1/servers/08130b1d-540c-4ad8-a9b6-8a8aa11f3282 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:41.682760 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:41.683586 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:41.702512 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:41.703113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:41.703617 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:41.718186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:41.718927 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:41.720684 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:41.764876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:13:41.890856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-02643999-9b26-47b0-bf9b-99fbdb2fa307 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 204 len: 0 microversion: 2.1 time: 0.210870 Aug 31 04:13:41.892031 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 432/858] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:13:41 2022] DELETE /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:13:41.903160 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:41.904275 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:41.911892 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:41.912498 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:41.913011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:41.913809 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:41.914379 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:41.914872 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.142230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:42.151015 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ca74e7d1-f4e6-412a-ae56-81c11c1a274c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1579 microversion: 2.1 time: 0.253774 Aug 31 04:13:42.151613 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 427/859] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:41 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1579 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:42.790429 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:42.790984 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:42.797502 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:42.797976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:42.798404 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.799113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:42.799554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:42.799966 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.814294 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f HTTP/1.1 Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:42.816164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.817764 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '2a2ce931-07fc-460a-a503-f4cf14e7529f'} Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:42.818839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.820354 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.822182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:42.822182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5a26ac88-9d3a-4847-b67c-1dce5f970970 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 404 len: 111 microversion: 2.1 time: 0.031337 Aug 31 04:13:42.822182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 433/860] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:13:42 2022] DELETE /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:42.827159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:42.827985 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 2a2ce931-07fc-460a-a503-f4cf14e7529f] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:42.835011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:42.835583 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:42.836070 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.836840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:42.837647 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:42.838131 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.854124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f HTTP/1.1 Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:13:42.856993 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.858639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '2a2ce931-07fc-460a-a503-f4cf14e7529f'} Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:42.859561 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. Aug 31 04:13:42.860990 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.863245 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 2a2ce931-07fc-460a-a503-f4cf14e7529f could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:42.864465 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e5135a3e-2dc7-448e-aef4-472bb1b25a13 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f" status: 404 len: 111 microversion: 2.1 time: 0.040982 Aug 31 04:13:42.864823 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 428/861] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:42 2022] GET /compute/v2.1/servers/2a2ce931-07fc-460a-a503-f4cf14e7529f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:42.872867 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:42.873356 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:42.879322 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:42.879811 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:42.880230 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.880907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:42.881348 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:42.881759 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.895478 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 HTTP/1.1 Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:42.897068 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.898574 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'fdae6298-1a2e-4f4a-88e0-32a21a1fed41'} Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:42.899809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.901046 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.902296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:42.902296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1cb24b54-ad57-4784-b581-ee026a13224f tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 404 len: 111 microversion: 2.1 time: 0.029422 Aug 31 04:13:42.902296 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 434/862] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:13:42 2022] DELETE /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:42.907010 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:42.907639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: fdae6298-1a2e-4f4a-88e0-32a21a1fed41] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:42.914355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:42.914846 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:42.915405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.916176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:42.916628 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:42.917055 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:42.931050 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 HTTP/1.1 Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:13:42.932531 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.933948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': 'fdae6298-1a2e-4f4a-88e0-32a21a1fed41'} Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:42.934700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. Aug 31 04:13:42.937600 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:42.938814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance fdae6298-1a2e-4f4a-88e0-32a21a1fed41 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:42.938814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e7d7c792-bb6b-44f7-8ab1-63e24d15e123 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41" status: 404 len: 111 microversion: 2.1 time: 0.030930 Aug 31 04:13:42.938814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 429/863] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:42 2022] GET /compute/v2.1/servers/fdae6298-1a2e-4f4a-88e0-32a21a1fed41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:43.173140 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:43.173961 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:43.183256 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:43.187004 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:43.187452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:43.190824 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:43.191306 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:43.191817 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:43.612545 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:43.622393 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a4fb13f2-7bea-4b3b-90ea-c276d62628e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1579 microversion: 2.1 time: 0.453564 Aug 31 04:13:43.628517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 435/864] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:43 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1579 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:44.121886 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:44.122476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:44.142111 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:44.143204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:44.144056 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:44.145870 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:44.146547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:44.147345 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:44.164489 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: DELETE /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 HTTP/1.1 Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:13:44.166530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.168510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '8e5504b0-52b4-4d1a-a67b-6d6e26053371'} Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:44.170197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.171880 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.173588 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:44.173588 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ebd3003b-0cc1-4b3e-8d95-77b99b2c2cbc tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 404 len: 111 microversion: 2.1 time: 0.050556 Aug 31 04:13:44.173588 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 430/865] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:13:44 2022] DELETE /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:44.178220 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:44.179416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] [instance: 8e5504b0-52b4-4d1a-a67b-6d6e26053371] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:44.187315 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:44.188385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:44.189206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:44.190811 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:44.191405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:44.192009 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:44.209945 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] HTTP exception thrown: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Request method failure captured: Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 HTTP/1.1 Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt5LpQq5QBZVNUuJMmNcRBl5J9yQuczXlpN_s0QOBd08NWsaniDlxFNsimCWN07sQeEOK-QO4D9nHWz6z4UAfr3aCRko8qCqBgf9HSyXdQqgriw6mwZ0Qw5umolsU5Y5IXP1SPMpODq-tBlQdWiT1FyttfbHX6Xu6jm8rHZRb2Y1-aE Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:13:44.211633 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdbbb020a1944de2a8fa16379f8cec7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdbbb020a1944de2a8fa16379f8cec7d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: fdbbb020a1944de2a8fa16379f8cec7d Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2036838542 Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: f80c8c1d6af7450eb8f936df231ad63b Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-2036838542-project Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.213415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '8e5504b0-52b4-4d1a-a67b-6d6e26053371'} Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:44.214353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. Aug 31 04:13:44.215884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:13:44.217374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] Returning 404 to user: Instance 8e5504b0-52b4-4d1a-a67b-6d6e26053371 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:44.217374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4f945921-4a93-45fc-a216-a5fd5b610f11 tempest-AttachVolumeNegativeTest-2036838542 tempest-AttachVolumeNegativeTest-2036838542-project] 10.222.0.18 "GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371" status: 404 len: 111 microversion: 2.1 time: 0.039779 Aug 31 04:13:44.217374 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 436/866] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:44 2022] GET /compute/v2.1/servers/8e5504b0-52b4-4d1a-a67b-6d6e26053371 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:44.649973 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:44.650545 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:44.656950 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:44.657434 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:44.657906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:44.658609 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:44.659125 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:44.659512 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:44.964867 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:44.980326 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bef9db83-211e-44ff-b581-cb9fcc66fb95 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1579 microversion: 2.1 time: 0.333508 Aug 31 04:13:44.980326 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 431/867] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:44 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1579 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:45.723990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-5862e9c2-d7ac-4558-83dd-b694413181c4 req-d19c91ec-5040-49f1-9a31-f75c605f6b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d85740-5090-4429-a8fb-61391968c231", "name": "network-vif-deleted", "tag": "0319ee82-d626-405b-8c17-c745da1ac289"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:45.773501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5862e9c2-d7ac-4558-83dd-b694413181c4 req-d19c91ec-5040-49f1-9a31-f75c605f6b04 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:45.790827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5862e9c2-d7ac-4558-83dd-b694413181c4 req-d19c91ec-5040-49f1-9a31-f75c605f6b04 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:45.791391 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5862e9c2-d7ac-4558-83dd-b694413181c4 req-d19c91ec-5040-49f1-9a31-f75c605f6b04 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:45.806827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-5862e9c2-d7ac-4558-83dd-b694413181c4 req-d19c91ec-5040-49f1-9a31-f75c605f6b04 service nova] Creating event network-vif-deleted:0319ee82-d626-405b-8c17-c745da1ac289 for instance d1d85740-5090-4429-a8fb-61391968c231 on hv-cinder-85391 Aug 31 04:13:45.812340 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-5862e9c2-d7ac-4558-83dd-b694413181c4 req-d19c91ec-5040-49f1-9a31-f75c605f6b04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092650 Aug 31 04:13:45.813534 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 437/868] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:46.005067 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:46.006102 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:46.022450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:46.023321 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:46.023936 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:46.025451 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:46.029581 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:46.030065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:46.087299 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0883da66-75ab-47c5-957e-c31c2ae94ba2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'create', calling method: .version_select at 0x7f88ad1c24c0>, body: {"keypair": {"name": "tempest-keypair-1224399709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAC6gx8KvdL3RQ2wknb9Mj055a/9dWY33J5tSbyFybKcZqIWHbNyWnxYvZiY57qrfhW2nT+PV3Tskfsfg28oK+kMcPfjt7hs7BfwLq7Kh34v5fYSN6FAZFDjPxsK7Krag=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:46.142596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-0883da66-75ab-47c5-957e-c31c2ae94ba2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Getting quotas for project b2f251186d5346d9ae213f018e299cb4. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:13:46.159626 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-0883da66-75ab-47c5-957e-c31c2ae94ba2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Getting quotas for user e29d3d1942614652b3229888d04dc5bf and project b2f251186d5346d9ae213f018e299cb4. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:13:46.243855 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:46.256046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0883da66-75ab-47c5-957e-c31c2ae94ba2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.360500 Aug 31 04:13:46.257780 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 432/869] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:13:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:46.261324 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-831ec29b-7267-41fc-903a-6e4bc2217f7d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 200 len: 1226 microversion: 2.1 time: 0.261619 Aug 31 04:13:46.274962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 438/870] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:45 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 1226 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:13:47.296736 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:47.298432 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:47.308169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:47.315848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:47.323256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:47.325099 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:47.326831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:47.327354 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:47.369123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] HTTP exception thrown: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Request method failure captured: Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 HTTP/1.1 Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt9IqK30Ffii3LsXP7lT-rclhmhWfQbZzp78OkRwktqgo8sdzltIWvdsVAQjiFdJJO2VZTLbFWbi0i97ZWRYn13LNN1JnW3L_c6JMhUhoR11j7zaWzaaOhYHGAAuOE3fHr7vUTr5cDX4e77ohi8xUDI2c7sy3M7lmjUK0hDcMrXUOmU Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:13:47.371169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e6db5b66c75c499d98d02d6e0041299f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 62f5d4659eea4d91a689d709460396d2 Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:13:47.372667 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': 'd1d85740-5090-4429-a8fb-61391968c231'} Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:13:47.373511 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:13:47.374717 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:13:47.388565 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Returning 404 to user: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:13:47.389710 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0077124c-fad9-436a-b81d-68776651ca11 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 404 len: 111 microversion: 2.1 time: 0.103271 Aug 31 04:13:47.390954 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 433/871] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:47 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:47.656062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-671886853", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1423806456", "security_groups": [{"name": "tempest-secgroup-smoke-1889188028"}], "block_device_mapping_v2": [{"uuid": "2391cbdb-578e-4e09-b0ef-b1f92ed6124b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afdd8bcf-e898-41b9-a268-9083d2b02846"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:48.117636 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] validate_networks() for [('afdd8bcf-e898-41b9-a268-9083d2b02846', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:13:49.003554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:13:49.004178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:13:49.004746 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:13:49.005370 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:13:49.005985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:13:49.020253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:49.021178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:49.021824 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:49.022951 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:49.027248 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:49.028506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:49.104757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Getting quotas for project e6db5b66c75c499d98d02d6e0041299f. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:13:49.124805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Getting quotas for user 62f5d4659eea4d91a689d709460396d2 and project e6db5b66c75c499d98d02d6e0041299f. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:13:49.242039 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:13:49.244825 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2391cbdb-578e-4e09-b0ef-b1f92ed6124b',volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:13:49.417941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-584976941", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32e0d3cc-cecf-4072-861e-69e212464544"}], "security_groups": [{"name": "tempest-securitygroup--1527343295"}], "key_name": "tempest-keypair-1224399709", "user_data": "}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:49.577956 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3abf2163-a2b9-4c83-8735-7ece61c0fa70 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.926015 Aug 31 04:13:49.586924 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 439/872] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:13:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:13:49.602138 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4c4dec86-bfa1-44d6-8a49-99a1a4b956f9 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:49.607181 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4c4dec86-bfa1-44d6-8a49-99a1a4b956f9 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:49.856507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4c4dec86-bfa1-44d6-8a49-99a1a4b956f9 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:49.865616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4c4dec86-bfa1-44d6-8a49-99a1a4b956f9 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1094 microversion: 2.1 time: 0.274823 Aug 31 04:13:49.867168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 440/873] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:49 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1094 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:50.350278 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] validate_networks() for [('32e0d3cc-cecf-4072-861e-69e212464544', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:13:50.891535 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:50.892890 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:50.901802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:50.902644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:50.903269 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:50.904143 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:50.904792 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:50.905482 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:51.013891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:13:51.014444 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:13:51.014872 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:13:51.015351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:13:51.015804 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:13:51.030580 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:51.031185 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:51.040351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:51.043689 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:51.044563 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:51.045160 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:51.069081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Getting quotas for project b2f251186d5346d9ae213f018e299cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:13:51.073894 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Getting quotas for user e29d3d1942614652b3229888d04dc5bf and project b2f251186d5346d9ae213f018e299cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:13:51.088237 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:13:51.090911 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:13:51.121227 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:51.135765 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e3bccc31-d393-4a4c-9633-8873733976c1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1192 microversion: 2.1 time: 0.247991 Aug 31 04:13:51.138617 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 441/874] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:50 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1192 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:51.181943 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-af13b956-92b8-4367-ae24-e66aa90c3bce tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.767764 Aug 31 04:13:51.183096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 434/875] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:13:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:13:51.199249 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-33d605b8-9596-48a5-97e7-d91a2a08f0e0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:51.199949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-33d605b8-9596-48a5-97e7-d91a2a08f0e0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:51.288186 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-33d605b8-9596-48a5-97e7-d91a2a08f0e0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:51.297677 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-33d605b8-9596-48a5-97e7-d91a2a08f0e0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1237 microversion: 2.1 time: 0.106167 Aug 31 04:13:51.298698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 442/876] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:51 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:52.196437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:52.199656 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:52.221214 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:52.226759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:52.227757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:52.228877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:52.229338 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:52.229769 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:52.319753 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:52.320483 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:52.327506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:52.327996 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:52.328422 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:52.329681 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:52.330299 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:52.330730 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:52.447940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:52.458477 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-176c8e61-1f71-45a4-81f0-98c0ab6f9361 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1289 microversion: 2.1 time: 0.142682 Aug 31 04:13:52.459421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 443/877] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:52 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1289 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:13:52.513363 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:52.523763 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-49ebb98d-57ed-47a1-b1f2-50b04bf11900 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.362351 Aug 31 04:13:52.525549 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 435/878] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:52 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:13:53.483901 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:53.484868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:53.495900 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-76ed8d3f-d5bb-4562-b65b-e92d92a3221c req-d4dff0e5-4353-470b-a658-a854a6d92ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f732c2-506d-4871-825e-2672cb8a2452", "tag": "cec5d875-c053-4ef2-a631-7779726cb122"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:53.507993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:53.513724 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:53.514233 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:53.517225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-76ed8d3f-d5bb-4562-b65b-e92d92a3221c req-d4dff0e5-4353-470b-a658-a854a6d92ace service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:53.517706 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-76ed8d3f-d5bb-4562-b65b-e92d92a3221c req-d4dff0e5-4353-470b-a658-a854a6d92ace service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:53.518131 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-76ed8d3f-d5bb-4562-b65b-e92d92a3221c req-d4dff0e5-4353-470b-a658-a854a6d92ace service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:53.518262 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:53.518749 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:53.519224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:53.553975 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-76ed8d3f-d5bb-4562-b65b-e92d92a3221c req-d4dff0e5-4353-470b-a658-a854a6d92ace service nova] Creating event network-changed:cec5d875-c053-4ef2-a631-7779726cb122 for instance d0f732c2-506d-4871-825e-2672cb8a2452 on hv-cinder-85391 Aug 31 04:13:53.561176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-76ed8d3f-d5bb-4562-b65b-e92d92a3221c req-d4dff0e5-4353-470b-a658-a854a6d92ace service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069030 Aug 31 04:13:53.562332 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 436/879] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:53.570328 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:53.572417 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:53.584020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:53.584689 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:53.584998 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:53.586713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:53.587938 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:53.588453 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:53.667849 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:53.676850 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-19884256-c37a-43bf-ac28-160cc52bb808 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1295 microversion: 2.1 time: 0.200700 Aug 31 04:13:53.679070 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 444/880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:53 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1295 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:53.947242 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:53.951854 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:53.960143 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6d6a721a-4637-49bc-8556-2b726f31fd4d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.394658 Aug 31 04:13:53.961703 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 437/881] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:53 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:54.701016 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:54.702273 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:54.709149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:54.710087 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:54.710957 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:54.712194 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:54.712713 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:54.713134 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:54.985238 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:54.985873 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:54.994184 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:54.994652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:54.995804 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:54.997031 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:54.997808 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:54.998458 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:55.122913 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:55.131423 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-80215d83-27bb-4801-a552-2e24134bbfc0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1363 microversion: 2.1 time: 0.435178 Aug 31 04:13:55.131990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 445/882] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:54 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:55.286928 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:55.295461 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0a7cea9f-e80e-4d6e-813a-642a8a58dd1c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.314851 Aug 31 04:13:55.296052 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 438/883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:54 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:55.604350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-829e9144-e1c0-4d9a-a792-ccba6e34d945 req-b6d41003-80b7-4aa9-a7f4-0f9551ab1ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907b5ebd-7261-41d9-bfd5-a4f871d87663", "tag": "90137c1b-a64b-4fe2-ba88-e0e33d96d34a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:13:55.615985 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-829e9144-e1c0-4d9a-a792-ccba6e34d945 req-b6d41003-80b7-4aa9-a7f4-0f9551ab1ff1 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:55.616512 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-829e9144-e1c0-4d9a-a792-ccba6e34d945 req-b6d41003-80b7-4aa9-a7f4-0f9551ab1ff1 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:55.617170 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-829e9144-e1c0-4d9a-a792-ccba6e34d945 req-b6d41003-80b7-4aa9-a7f4-0f9551ab1ff1 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:55.630517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-829e9144-e1c0-4d9a-a792-ccba6e34d945 req-b6d41003-80b7-4aa9-a7f4-0f9551ab1ff1 service nova] Creating event network-changed:90137c1b-a64b-4fe2-ba88-e0e33d96d34a for instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 on hv-cinder-85391 Aug 31 04:13:55.635468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-829e9144-e1c0-4d9a-a792-ccba6e34d945 req-b6d41003-80b7-4aa9-a7f4-0f9551ab1ff1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036428 Aug 31 04:13:55.636074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 446/884] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:13:56.160336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:56.160946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:56.168115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:56.168902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:56.169495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:56.170456 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:56.170936 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:56.171537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:56.316878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:56.318218 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:56.326117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:56.326953 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:56.327572 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:56.328674 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:56.329370 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:56.329984 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:56.332737 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:56.349840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c553249e-5a15-43a2-9097-18451cd494ca tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1363 microversion: 2.1 time: 0.199345 Aug 31 04:13:56.350689 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 439/885] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:56 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:56.487171 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:56.495646 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4587b5a4-7801-4017-8934-5535c5dc92c4 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.183238 Aug 31 04:13:56.496253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 447/886] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:56 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:13:57.372403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:57.373197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:57.389532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:57.390034 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:57.390468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:57.391212 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:57.391669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:57.392085 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:57.517397 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:57.518121 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:57.527977 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:57.528493 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:57.529131 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:57.529717 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:57.530177 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:57.530789 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:57.622072 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:57.635152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8256a8c6-f881-4b67-b6f7-6d94183579ef tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1363 microversion: 2.1 time: 0.266481 Aug 31 04:13:57.648411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 440/887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:57 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:57.697494 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:57.705916 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d2314e0c-59ed-4443-a9d7-7ee6be3ace91 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.193072 Aug 31 04:13:57.706513 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 448/888] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:57 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:58.660198 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:58.660806 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:58.668768 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:58.669256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:58.669684 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:58.670376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:58.670972 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:58.671586 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:58.726202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:58.728034 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:58.749120 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:58.749763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:58.750450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:58.751362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:58.751913 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:58.752565 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:58.880254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:58.888133 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6aede2c0-1d52-4c89-aa54-e2a441ec9ad9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1363 microversion: 2.1 time: 0.232350 Aug 31 04:13:58.889455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 441/889] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:58 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:58.957136 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:13:58.965074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2339e602-5813-4d2a-b051-9e3d014b0a62 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.242740 Aug 31 04:13:58.965734 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 449/890] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:58 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:13:59.909745 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:59.910560 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:59.917230 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:59.917776 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:59.918139 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:59.918831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:59.919381 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:59.919733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:59.987428 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:13:59.988348 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:13:59.990420 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:59.997132 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:59.997627 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:13:59.998088 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:13:59.998927 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:13:59.999595 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:00.000008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:00.090628 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:00.098705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c9478241-9229-4248-8c14-d0a313f2ae4e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1363 microversion: 2.1 time: 0.192680 Aug 31 04:14:00.106774 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 442/891] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:59 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:00.158903 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:00.167041 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cb064d2e-7584-4d47-aeda-0e60041a13c0 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.184405 Aug 31 04:14:00.167618 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 450/892] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:13:59 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:00.663534 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-926c5830-96a7-4823-8334-5bd70547dcb9 req-489b30f9-542b-42bf-b882-199f9c357b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907b5ebd-7261-41d9-bfd5-a4f871d87663", "name": "network-vif-plugged", "status": "completed", "tag": "90137c1b-a64b-4fe2-ba88-e0e33d96d34a"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:14:00.674985 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-926c5830-96a7-4823-8334-5bd70547dcb9 req-489b30f9-542b-42bf-b882-199f9c357b14 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:00.675498 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-926c5830-96a7-4823-8334-5bd70547dcb9 req-489b30f9-542b-42bf-b882-199f9c357b14 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:00.675925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-926c5830-96a7-4823-8334-5bd70547dcb9 req-489b30f9-542b-42bf-b882-199f9c357b14 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:00.687865 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-926c5830-96a7-4823-8334-5bd70547dcb9 req-489b30f9-542b-42bf-b882-199f9c357b14 service nova] Creating event network-vif-plugged:90137c1b-a64b-4fe2-ba88-e0e33d96d34a for instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 on hv-cinder-85391 Aug 31 04:14:00.693296 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-926c5830-96a7-4823-8334-5bd70547dcb9 req-489b30f9-542b-42bf-b882-199f9c357b14 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033717 Aug 31 04:14:00.693947 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 443/893] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:14:01.121099 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:01.121696 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:01.128202 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:01.128693 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:01.129128 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:01.129817 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:01.130272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:01.130694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:01.147506 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:01.186263 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:01.187906 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=10 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:01.194144 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:01.194865 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:01.203336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:01.203826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:01.204259 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:01.204962 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:01.205411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:01.205830 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:01.310284 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=10 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:01.416595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:01.425669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b78f931f-3958-48a7-a6c7-cb8a81ec08b1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.241273 Aug 31 04:14:01.426920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 444/894] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:01 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:01.462794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:01.470721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-43b44ce8-8534-43d6-a28e-6ad072a2eae7 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1363 microversion: 2.1 time: 0.354255 Aug 31 04:14:01.471342 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 451/895] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:01 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1363 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:02.446253 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:02.447586 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:02.454705 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:02.455516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:02.455944 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:02.456628 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:02.457060 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:02.457490 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:02.498432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:02.503954 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:02.511706 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:02.514204 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:02.515426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:02.516206 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:02.517146 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:02.517921 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:02.518530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:02.662974 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:02.671793 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-872a6da8-945f-45aa-9204-ad5efaf43f6d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.229654 Aug 31 04:14:02.685316 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 445/896] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:02 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:02.716048 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-776eaffd-a492-4d4d-bac5-29a2dd6d5a22 req-8bb6fade-dc27-4d43-8f74-af45712169ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f732c2-506d-4871-825e-2672cb8a2452", "name": "network-vif-plugged", "status": "completed", "tag": "cec5d875-c053-4ef2-a631-7779726cb122"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:14:02.719640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:02.727442 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-776eaffd-a492-4d4d-bac5-29a2dd6d5a22 req-8bb6fade-dc27-4d43-8f74-af45712169ad service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:02.728380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-776eaffd-a492-4d4d-bac5-29a2dd6d5a22 req-8bb6fade-dc27-4d43-8f74-af45712169ad service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:02.728694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c5849e37-6a81-4be6-bd88-229d3cc608dd tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1549 microversion: 2.1 time: 0.238456 Aug 31 04:14:02.728821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-776eaffd-a492-4d4d-bac5-29a2dd6d5a22 req-8bb6fade-dc27-4d43-8f74-af45712169ad service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:02.743080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 452/897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:02 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1549 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:14:02.743358 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-776eaffd-a492-4d4d-bac5-29a2dd6d5a22 req-8bb6fade-dc27-4d43-8f74-af45712169ad service nova] Creating event network-vif-plugged:cec5d875-c053-4ef2-a631-7779726cb122 for instance d0f732c2-506d-4871-825e-2672cb8a2452 on hv-cinder-85391 Aug 31 04:14:02.748300 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-776eaffd-a492-4d4d-bac5-29a2dd6d5a22 req-8bb6fade-dc27-4d43-8f74-af45712169ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036128 Aug 31 04:14:02.749118 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 446/898] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:14:02.752190 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:02.752865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:02.759924 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:02.760421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:02.760849 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:02.761569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:02.762050 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:02.762500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:02.846016 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-07e23da7-b4d4-48b0-87d2-dbbe6b68b845 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098540 Aug 31 04:14:02.846618 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 453/899] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 31 04:14:02 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:14:03.693162 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:03.693865 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:03.701507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:03.701997 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:03.702429 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:03.703569 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:03.704025 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:03.704447 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:03.810530 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-26c76573-3282-4f79-bdaa-32d0fa65d528 req-c4ad25ed-9fcb-4a68-b564-552e42f259e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907b5ebd-7261-41d9-bfd5-a4f871d87663", "tag": "90137c1b-a64b-4fe2-ba88-e0e33d96d34a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:14:03.820828 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-26c76573-3282-4f79-bdaa-32d0fa65d528 req-c4ad25ed-9fcb-4a68-b564-552e42f259e3 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:03.821453 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-26c76573-3282-4f79-bdaa-32d0fa65d528 req-c4ad25ed-9fcb-4a68-b564-552e42f259e3 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:03.821868 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-26c76573-3282-4f79-bdaa-32d0fa65d528 req-c4ad25ed-9fcb-4a68-b564-552e42f259e3 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:03.833727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-26c76573-3282-4f79-bdaa-32d0fa65d528 req-c4ad25ed-9fcb-4a68-b564-552e42f259e3 service nova] Creating event network-changed:90137c1b-a64b-4fe2-ba88-e0e33d96d34a for instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 on hv-cinder-85391 Aug 31 04:14:03.839111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-26c76573-3282-4f79-bdaa-32d0fa65d528 req-c4ad25ed-9fcb-4a68-b564-552e42f259e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Aug 31 04:14:03.839939 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 454/900] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:14:03.859514 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:03.867915 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-41e643c7-7c03-4d85-817e-aa6a5aedcbbe tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.179035 Aug 31 04:14:03.868784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 447/901] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:03 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:04.890235 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:04.890960 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:04.897533 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:04.898026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:04.898540 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:04.899303 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:04.899779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:04.900224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:05.168526 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:05.176745 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-12b21547-d44d-4fa4-85ee-1a69dfe29047 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.291463 Aug 31 04:14:05.177323 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 455/902] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:04 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:06.198300 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:06.198939 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:06.201611 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:06.207467 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:06.207941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:06.208374 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:06.209063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:06.209504 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:06.209922 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:06.349697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:06.361987 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-18db6ac2-f156-4fda-9d96-d8dba83d1f2d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1266 microversion: 2.1 time: 0.167974 Aug 31 04:14:06.362725 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 448/903] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:06 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:07.393402 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:07.394220 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:07.405189 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:07.405934 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:07.406676 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:07.407852 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:07.408594 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:07.409279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:07.561480 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:07.569562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2d628d48-1143-4ebf-b098-50043a0fdb12 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1453 microversion: 2.1 time: 0.182832 Aug 31 04:14:07.570164 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 456/904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:07 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:07.591087 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:07.591677 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:07.598380 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:07.598860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:07.599318 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:07.600006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:07.600449 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:07.600860 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:07.742650 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:07.752276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4d98a359-5f92-48d5-8577-5c9d1892bb4a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1453 microversion: 2.1 time: 0.165680 Aug 31 04:14:07.752884 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 449/905] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:07 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:10.095978 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-430d998b-d169-49a4-8eb6-aa2cb1669307 req-75386cbe-483a-4beb-b240-4502b44664b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f732c2-506d-4871-825e-2672cb8a2452", "tag": "cec5d875-c053-4ef2-a631-7779726cb122"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:14:10.108802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-430d998b-d169-49a4-8eb6-aa2cb1669307 req-75386cbe-483a-4beb-b240-4502b44664b4 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:10.109657 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-430d998b-d169-49a4-8eb6-aa2cb1669307 req-75386cbe-483a-4beb-b240-4502b44664b4 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:10.110118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-430d998b-d169-49a4-8eb6-aa2cb1669307 req-75386cbe-483a-4beb-b240-4502b44664b4 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:10.128074 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-430d998b-d169-49a4-8eb6-aa2cb1669307 req-75386cbe-483a-4beb-b240-4502b44664b4 service nova] Creating event network-changed:cec5d875-c053-4ef2-a631-7779726cb122 for instance d0f732c2-506d-4871-825e-2672cb8a2452 on hv-cinder-85391 Aug 31 04:14:10.134199 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-430d998b-d169-49a4-8eb6-aa2cb1669307 req-75386cbe-483a-4beb-b240-4502b44664b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047052 Aug 31 04:14:10.135112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 457/906] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:14:40.049223 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:40.049740 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:40.051902 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:40.052626 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=64 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:40.061416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:40.062297 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:40.063526 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:40.064538 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:40.065208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:40.065699 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:40.091433 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7c1e6967-f2a9-4be5-9c8d-ec3d7f7d8ae3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/ips" status: 200 len: 145 microversion: 2.1 time: 0.045361 Aug 31 04:14:40.091433 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 450/907] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:14:40 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:14:42.959527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2023df0-7077-4471-996d-a562746f0fa5"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:14:42.961988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:42.965509 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=11 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:42.966149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=29 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:42.970013 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:42.970542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:42.970993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:42.971715 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:42.972165 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:42.972585 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:43.237961 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d8baf8b5-6578-4dbe-8cba-9666362eb94f tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282700 Aug 31 04:14:43.238767 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 458/908] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:14:42 2022] POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:14:49.735020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d70ea324-15b5-4d67-9277-f697b488cb18 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:14:49.742217 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d70ea324-15b5-4d67-9277-f697b488cb18 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:49.742706 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d70ea324-15b5-4d67-9277-f697b488cb18 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:49.743209 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d70ea324-15b5-4d67-9277-f697b488cb18 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:49.805881 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d70ea324-15b5-4d67-9277-f697b488cb18 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Going to try to stop instance {{(pid=120661) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 04:14:49.856513 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d70ea324-15b5-4d67-9277-f697b488cb18 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/action" status: 202 len: 0 microversion: 2.1 time: 0.125079 Aug 31 04:14:49.860497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 451/909] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:14:49 2022] POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:14:49.867823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:49.868513 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:49.884825 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:49.885281 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:49.885707 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:49.886400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:49.886843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:49.887287 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:50.034460 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:50.043395 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-debbd18a-971a-4ab3-ae77-88e7b4a34bec tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.180581 Aug 31 04:14:50.044049 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 459/910] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:49 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:51.065866 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:51.066599 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:51.072942 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:51.073428 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:51.073862 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:51.074552 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:51.075004 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:51.075450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:51.207604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:51.216190 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-be08acbb-a75d-4f82-b2b4-af86ceeec100 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.155445 Aug 31 04:14:51.216762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 452/911] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:51 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:52.238514 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:52.239222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:52.241802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:14:52.241995 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Wed Aug 31 04:14:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 (ip 10.222.0.18) !!! Aug 31 04:14:52.247937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:52.248298 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:52.248783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:52.249507 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:52.250036 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:52.250441 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:52.388752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:52.397539 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0e87ce71-3dff-486d-899d-893580c6fe55 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.163422 Aug 31 04:14:52.398115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 460/912] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:52 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:53.422878 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:53.423953 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:53.434781 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:53.435661 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:53.436377 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:53.437520 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:53.438269 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:53.438970 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:53.583907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:53.592745 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-60d5ed90-beb9-4b98-860f-9ef749aa6ba6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.176318 Aug 31 04:14:53.593322 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 453/913] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:53 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:54.623657 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:54.624393 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:54.633517 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:54.634158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:54.634732 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:54.635690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:54.636292 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:54.636854 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:54.782908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:54.791865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b19dd232-e374-4a44-b21d-6591103b5d05 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.173689 Aug 31 04:14:54.792442 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 461/914] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:54 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:55.817672 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:55.818672 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:55.830018 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:55.830870 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:55.831357 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:55.832073 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:55.832532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:55.832991 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:55.973607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:55.987382 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0991ed68-fcab-4418-bc0f-4fd53483239a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.176439 Aug 31 04:14:55.988076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 454/915] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:55 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:57.018122 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:57.019091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:57.029821 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:57.030671 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:57.031470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:57.032616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:57.033353 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:57.034123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:57.177083 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:57.186316 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-da27174b-d470-4c2a-a140-5d2d9f16b95e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.174984 Aug 31 04:14:57.186888 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 462/916] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:57 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:58.212498 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:58.214748 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:58.226124 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:58.226919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:58.227675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:58.228805 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:58.229922 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:58.230850 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:58.366099 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:58.379330 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9d920ed4-c062-4c50-988b-e4c1597264fb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.173952 Aug 31 04:14:58.380026 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 455/917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:58 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:14:59.409315 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:14:59.410258 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:14:59.421038 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:59.421829 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:59.422549 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:59.423771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:14:59.424494 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:14:59.424914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:14:59.565089 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:14:59.573865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-eca72519-aab1-4033-a74a-516b5dc34cd3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.171133 Aug 31 04:14:59.574441 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 463/918] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:14:59 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:00.598459 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:00.599083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:00.606081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:00.606565 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:00.606992 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:00.607888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:00.608337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:00.608751 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:00.751651 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:00.764056 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0875c86f-2c2f-4682-a340-643a54704169 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.170593 Aug 31 04:15:00.764817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 456/919] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:00 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:01.790635 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:01.791747 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:01.801470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:01.801955 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:01.802383 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:01.803061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:01.803560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:01.803976 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:01.946902 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:01.955335 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c09c592b-1075-4be6-8b88-b4badb832b3d tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.171052 Aug 31 04:15:01.956161 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 464/920] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:01 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:02.978688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:02.979931 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:02.988724 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:02.989208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:02.989633 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:02.990344 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:02.990785 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:02.991238 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:03.125151 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:03.138115 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3105167f-d587-4403-b431-bb6c956a549a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.164601 Aug 31 04:15:03.138911 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 457/921] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:02 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:04.166266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:04.167225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:04.178588 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:04.179446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:04.180156 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:04.181279 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:04.182024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:04.182711 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:04.321844 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:04.330307 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b4777358-f7a9-4652-8648-2eb2e15774f8 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1723 microversion: 2.1 time: 0.171058 Aug 31 04:15:04.330878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 465/922] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:04 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:05.357080 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:05.358072 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:05.368352 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:05.368835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:05.369271 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:05.369957 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:05.370439 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:05.370835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:05.517241 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:05.531401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-713ef764-6e1b-4fd6-abbe-66cb6d043c2c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1700 microversion: 2.1 time: 0.180593 Aug 31 04:15:05.532602 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 458/923] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:05 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1700 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:05.561660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-334a2f2e-1e38-4d2a-801c-fb37c9061510 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:15:05.569242 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-334a2f2e-1e38-4d2a-801c-fb37c9061510 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:05.569725 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-334a2f2e-1e38-4d2a-801c-fb37c9061510 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:05.570157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-334a2f2e-1e38-4d2a-801c-fb37c9061510 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:05.632973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-334a2f2e-1e38-4d2a-801c-fb37c9061510 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Going to try to start instance {{(pid=120662) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 04:15:05.686712 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-334a2f2e-1e38-4d2a-801c-fb37c9061510 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/action" status: 202 len: 0 microversion: 2.1 time: 0.128512 Aug 31 04:15:05.687783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 466/924] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:15:05 2022] POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:15:05.696199 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:05.696805 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:05.702787 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:05.703299 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:05.703727 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:05.704412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:05.704861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:05.705295 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:05.873159 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:05.889861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-19428b35-6b1a-488d-8cdd-76589bb68cd2 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1709 microversion: 2.1 time: 0.196761 Aug 31 04:15:05.890645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 459/925] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:05 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1709 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:06.918451 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:06.919812 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:06.929265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:06.929743 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:06.930171 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:06.930853 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:06.931335 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:06.931760 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:07.070536 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:07.083527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-98c2c04d-1513-48be-a918-f1ce2804b097 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1709 microversion: 2.1 time: 0.171624 Aug 31 04:15:07.084302 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 467/926] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:06 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:08.111468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:08.112139 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:08.119829 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:08.120317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:08.120744 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:08.121446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:08.121894 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:08.122317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:08.279605 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:08.289361 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5c7f4aad-3a86-4deb-95ce-c5050d98c1e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1713 microversion: 2.1 time: 0.182061 Aug 31 04:15:08.289952 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 460/927] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:08 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1713 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:40.279989 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:40.281006 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:40.285263 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=20 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:40.286251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:40.296346 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:40.297241 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:40.297865 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:40.298580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:40.299060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:40.299476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:40.385862 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lazy-loading 'services' on Instance uuid 907b5ebd-7261-41d9-bfd5-a4f871d87663 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:15:40.476680 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1426eb92-38f9-473d-a64c-eb6643b49af9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/os-volume_attachments/e2023df0-7077-4471-996d-a562746f0fa5" status: 202 len: 0 microversion: 2.1 time: 0.203650 Aug 31 04:15:40.477281 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 468/928] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:15:40 2022] DELETE /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/os-volume_attachments/e2023df0-7077-4471-996d-a562746f0fa5 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:15:41.607011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-041e52ac-b6b9-4dc7-a702-021ef0ba62b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:15:41.610350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=22 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:41.611005 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:41.617152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-041e52ac-b6b9-4dc7-a702-021ef0ba62b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:41.617636 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-041e52ac-b6b9-4dc7-a702-021ef0ba62b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:41.618070 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-041e52ac-b6b9-4dc7-a702-021ef0ba62b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:41.641649 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-041e52ac-b6b9-4dc7-a702-021ef0ba62b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Going to try to stop instance {{(pid=120661) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 04:15:41.688943 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-041e52ac-b6b9-4dc7-a702-021ef0ba62b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/action" status: 202 len: 0 microversion: 2.1 time: 0.087874 Aug 31 04:15:41.689543 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 461/929] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:15:41 2022] POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:15:41.698715 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:41.699470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:41.705777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:41.706262 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:41.706689 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:41.707409 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:41.707861 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:41.708283 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:41.849454 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:41.858258 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cb615b5c-6f9d-4c70-9cff-a7449aaf7f92 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.164147 Aug 31 04:15:41.858845 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 469/930] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:41 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:15:42.882047 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:42.882750 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:42.889319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:42.889896 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:42.890523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:42.891279 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:42.891743 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:42.892152 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:43.033527 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:43.041934 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bf94c1b4-7d40-4956-8db1-28cb256dc94b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.164686 Aug 31 04:15:43.042481 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 462/931] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:42 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:44.066039 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:44.066655 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:44.073683 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:44.074187 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:44.074613 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:44.075332 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:44.075774 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:44.076189 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:44.218798 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:44.227267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-70cb0e6d-5da9-455a-ac52-38e160786683 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.166098 Aug 31 04:15:44.227805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 470/932] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:44 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:45.248970 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:45.249596 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:45.256460 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:45.256940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:45.257364 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:45.258053 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:45.258500 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:45.258912 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:45.402248 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:45.410212 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d6fec24b-0f6f-4bba-8681-ba529a0f3db0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.165164 Aug 31 04:15:45.410785 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 463/933] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:45 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:46.441259 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:46.442188 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:46.451655 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:46.452308 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:46.452876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:46.453842 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:46.454495 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:46.455147 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:46.596505 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:46.609777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-edf612bc-6a58-40f0-a3ec-dbf4ee73b8f1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.174000 Aug 31 04:15:46.610645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 471/934] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:46 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:47.634446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:47.635398 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:47.641888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:47.642434 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:47.642870 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:47.643615 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:47.644069 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:47.644495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:47.788342 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:47.797164 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ad7df4ed-2aaf-4065-93d9-42760fcc7248 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.166779 Aug 31 04:15:47.797720 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 464/935] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:47 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:48.819990 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:48.821201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:48.829758 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:48.830373 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:48.830914 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:48.831820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:48.832385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:48.832917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:48.978645 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:48.986986 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-de498e95-2c1a-43d9-9423-906da452076e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.171948 Aug 31 04:15:48.987624 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 472/936] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:48 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:50.012494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:50.013427 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:50.024227 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:50.024923 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:50.025350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:50.026032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:50.026476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:50.026892 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:50.177535 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:50.185815 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-907ef2d4-9188-4644-96c5-6b1e34e22ccb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.180275 Aug 31 04:15:50.186395 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 465/937] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:50 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:51.208149 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:51.208796 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:51.216036 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:51.216527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:51.216983 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:51.217682 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:51.218136 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:51.218560 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:51.357417 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:51.365556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7d7824e2-dd39-4c74-8d98-381c127b4558 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1677 microversion: 2.1 time: 0.161732 Aug 31 04:15:51.366189 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 473/938] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:51 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:52.387415 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:52.388021 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:52.394335 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:52.394817 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:52.395276 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:52.395965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:52.396411 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:52.396821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:52.532944 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:52.541394 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-733e6a27-f92f-4055-bf75-d778d44acb80 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1654 microversion: 2.1 time: 0.157923 Aug 31 04:15:52.542094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 466/939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:52 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:52.562856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-037b095e-3839-44bd-9d55-d23fabb77107 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:15:52.570367 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-037b095e-3839-44bd-9d55-d23fabb77107 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:52.571214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-037b095e-3839-44bd-9d55-d23fabb77107 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:52.571898 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-037b095e-3839-44bd-9d55-d23fabb77107 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:52.597078 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-037b095e-3839-44bd-9d55-d23fabb77107 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Going to try to start instance {{(pid=120662) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 04:15:52.648721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-037b095e-3839-44bd-9d55-d23fabb77107 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/action" status: 202 len: 0 microversion: 2.1 time: 0.089463 Aug 31 04:15:52.649325 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 474/940] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:15:52 2022] POST /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:15:52.657910 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:52.658516 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:52.665240 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:52.665685 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:52.666215 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:52.667006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:52.667733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:52.668446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:52.893475 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:52.902785 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4f8f3176-52cf-4084-b87b-f779276b0341 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1663 microversion: 2.1 time: 0.248792 Aug 31 04:15:52.903402 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 467/941] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:52 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1663 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 04:15:53.930058 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:53.931091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:53.941877 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:53.942678 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:53.943465 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:53.944601 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:53.945351 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:53.946052 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:54.094659 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:54.103726 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-318d0e22-d023-4e14-b26f-d6d099018d48 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1663 microversion: 2.1 time: 0.180883 Aug 31 04:15:54.104466 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 475/942] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:53 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:55.130565 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:55.131232 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:55.137931 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:55.138403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:55.138832 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:55.139593 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:55.140048 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:55.140471 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:55.281078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:55.290963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a33350a8-7154-4780-9099-87b3923388c0 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1667 microversion: 2.1 time: 0.164119 Aug 31 04:15:55.291759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 468/943] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:55 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:55.974270 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-349738043", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1423806456", "security_groups": [{"name": "tempest-secgroup-smoke-1889188028"}], "block_device_mapping_v2": [{"uuid": "5bb7eab8-14e6-491a-9cd8-8d69d99e4bb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afdd8bcf-e898-41b9-a268-9083d2b02846"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:15:56.107709 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] validate_networks() for [('afdd8bcf-e898-41b9-a268-9083d2b02846', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:15:56.496426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:15:56.496850 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:15:56.497351 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:15:56.497722 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:15:56.498305 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:15:56.507602 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:56.508085 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:56.508876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:56.509581 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:56.510029 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:56.510445 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:56.527456 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Getting quotas for project e6db5b66c75c499d98d02d6e0041299f. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:15:56.531569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Getting quotas for user 62f5d4659eea4d91a689d709460396d2 and project e6db5b66c75c499d98d02d6e0041299f. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:15:56.596762 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:15:56.598971 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5bb7eab8-14e6-491a-9cd8-8d69d99e4bb3',volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:15:56.746640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-df930d0f-e363-494f-b49d-30479af2f2ce tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778958 Aug 31 04:15:56.747416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 476/944] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:15:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:15:56.759207 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-504fb02a-d472-440a-a0ae-3fa5f98118d5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:56.759821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-504fb02a-d472-440a-a0ae-3fa5f98118d5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:56.817700 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-504fb02a-d472-440a-a0ae-3fa5f98118d5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:56.824726 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-504fb02a-d472-440a-a0ae-3fa5f98118d5 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1094 microversion: 2.1 time: 0.069569 Aug 31 04:15:56.825333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 469/945] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:56 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:57.846379 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:57.847131 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:57.854055 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:57.854636 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:57.855162 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:57.855988 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:57.856457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:57.857210 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:57.937410 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:57.945093 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bbad649c-8f3c-4948-a933-21f141b307fa tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1210 microversion: 2.1 time: 0.103659 Aug 31 04:15:57.945858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 477/946] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:57 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:15:59.129058 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:15:59.129716 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:15:59.136587 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:59.137131 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:59.137560 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:59.138242 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:59.138682 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:59.139123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:59.280317 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a8203b75-8d77-4c5f-80b6-dbbffdc07d80 req-82383807-9e90-424c-b129-ba68fac81656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008761e5-2f82-425b-8156-4262dc16ebaa", "tag": "2e10088a-8bb6-4d01-af36-44f371a379a6"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:15:59.294113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a8203b75-8d77-4c5f-80b6-dbbffdc07d80 req-82383807-9e90-424c-b129-ba68fac81656 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:15:59.294788 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a8203b75-8d77-4c5f-80b6-dbbffdc07d80 req-82383807-9e90-424c-b129-ba68fac81656 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:15:59.295330 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a8203b75-8d77-4c5f-80b6-dbbffdc07d80 req-82383807-9e90-424c-b129-ba68fac81656 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:15:59.308519 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a8203b75-8d77-4c5f-80b6-dbbffdc07d80 req-82383807-9e90-424c-b129-ba68fac81656 service nova] Creating event network-changed:2e10088a-8bb6-4d01-af36-44f371a379a6 for instance 008761e5-2f82-425b-8156-4262dc16ebaa on hv-cinder-85391 Aug 31 04:15:59.314476 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a8203b75-8d77-4c5f-80b6-dbbffdc07d80 req-82383807-9e90-424c-b129-ba68fac81656 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037804 Aug 31 04:15:59.315082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 478/947] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:15:59.374805 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:15:59.383397 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-37dbbe67-37dd-4b4a-82e3-11191baefb72 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.421355 Aug 31 04:15:59.383965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 470/948] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:15:58 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:00.407421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:00.408154 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:00.414941 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:00.415580 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:00.416854 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:00.417559 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:00.418024 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:00.418452 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:00.595999 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:00.604109 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e5a25441-e48a-4601-9e19-8acacb770748 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.203340 Aug 31 04:16:00.604695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 479/949] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:00 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:01.628547 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:01.629135 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:01.636723 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:01.637258 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:01.637730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:01.638481 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:01.638973 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:01.639476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:01.785858 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:01.795647 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4a5e7665-e10a-4e12-ace2-824a07edbbba tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.173140 Aug 31 04:16:01.796201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 471/950] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:01 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:02.820213 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:02.820870 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:02.831008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:02.831524 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:02.831963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:02.832669 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:02.833113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:02.833531 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:02.978983 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:02.987690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-88dc3c71-48c6-458d-8c19-22edec5d5550 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.174548 Aug 31 04:16:02.988266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 480/951] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:02 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:04.017554 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:04.019123 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:04.030134 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:04.030961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:04.031732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:04.032864 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:04.033716 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:04.034313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:04.179542 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:04.191598 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b24a6e31-31e9-445f-a6f1-01ca81173a50 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.180153 Aug 31 04:16:04.192368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 472/952] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:04 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:05.216748 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:05.217686 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:05.228999 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:05.229802 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:05.230522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:05.231721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:05.232473 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:05.233178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:05.373600 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:05.385544 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-93103dff-2fcb-4bb9-b26d-308fc03de88a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.175056 Aug 31 04:16:05.386468 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 481/953] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:05 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:06.412451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:06.413096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:06.420714 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:06.421260 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:06.421735 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:06.422495 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:06.422987 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:06.423486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:06.570573 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:06.578883 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b7618223-b724-4645-a879-8cde1cd23fae tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.172247 Aug 31 04:16:06.579497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 473/954] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:06 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:07.600403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:07.601115 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:07.605112 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:07.606124 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:07.610207 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:07.610697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:07.611157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:07.611846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:07.612298 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:07.612721 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:07.750457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:07.758639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0afe849b-72ad-4451-97fc-f6cf7585331a tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.162239 Aug 31 04:16:07.759277 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 482/955] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:07 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:08.787446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:08.788059 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:08.790032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:08.796151 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:08.796606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:08.797064 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:08.797749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:08.798194 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:08.798610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:08.943851 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:08.952032 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f5c7d47f-3a1a-4c3a-9c56-0a1d852d2328 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.169605 Aug 31 04:16:08.952630 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 474/956] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:08 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:09.075104 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-ba542386-76e0-4b33-9ff9-21162e91bf64 req-d5f1b1ef-69df-44b7-97d4-fb4e01cd42b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008761e5-2f82-425b-8156-4262dc16ebaa", "name": "network-vif-plugged", "status": "completed", "tag": "2e10088a-8bb6-4d01-af36-44f371a379a6"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:16:09.088157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ba542386-76e0-4b33-9ff9-21162e91bf64 req-d5f1b1ef-69df-44b7-97d4-fb4e01cd42b7 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:09.088859 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ba542386-76e0-4b33-9ff9-21162e91bf64 req-d5f1b1ef-69df-44b7-97d4-fb4e01cd42b7 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:09.089285 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ba542386-76e0-4b33-9ff9-21162e91bf64 req-d5f1b1ef-69df-44b7-97d4-fb4e01cd42b7 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:09.103336 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-ba542386-76e0-4b33-9ff9-21162e91bf64 req-d5f1b1ef-69df-44b7-97d4-fb4e01cd42b7 service nova] Creating event network-vif-plugged:2e10088a-8bb6-4d01-af36-44f371a379a6 for instance 008761e5-2f82-425b-8156-4262dc16ebaa on hv-cinder-85391 Aug 31 04:16:09.108427 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-ba542386-76e0-4b33-9ff9-21162e91bf64 req-d5f1b1ef-69df-44b7-97d4-fb4e01cd42b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037202 Aug 31 04:16:09.109021 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 483/957] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:16:09.976396 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:09.977269 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:09.984501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:09.984987 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:09.985422 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:09.986132 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:09.986584 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:09.987005 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:10.151465 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:10.162167 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b979b04c-fb4d-4d5d-9440-28cda88ca2ef tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1266 microversion: 2.1 time: 0.192704 Aug 31 04:16:10.162925 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 475/958] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:09 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:11.203389 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:11.205511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:11.209628 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:11.215670 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:11.216160 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:11.216592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:11.217307 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:11.217757 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:11.218173 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:11.221586 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:11.367425 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:11.375650 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-16b2c087-43c6-4a5b-8ca5-1758669ec314 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1454 microversion: 2.1 time: 0.186302 Aug 31 04:16:11.376203 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 484/959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:11 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:11.395544 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:11.396170 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:11.403421 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:11.403907 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:11.404339 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:11.405013 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:11.405494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:11.405920 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:11.554096 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:11.562497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9a7769bb-7e00-4705-a881-35f9651b366b tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1454 microversion: 2.1 time: 0.170792 Aug 31 04:16:11.563085 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 476/960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:11 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:13.451171 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-8969a14f-2312-47d1-94c1-a53946f79885 req-439a5fdf-8d05-4b02-8640-70f171b83f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008761e5-2f82-425b-8156-4262dc16ebaa", "tag": "2e10088a-8bb6-4d01-af36-44f371a379a6"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:16:13.460964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8969a14f-2312-47d1-94c1-a53946f79885 req-439a5fdf-8d05-4b02-8640-70f171b83f44 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:13.461416 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8969a14f-2312-47d1-94c1-a53946f79885 req-439a5fdf-8d05-4b02-8640-70f171b83f44 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:13.461838 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8969a14f-2312-47d1-94c1-a53946f79885 req-439a5fdf-8d05-4b02-8640-70f171b83f44 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:13.473173 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-8969a14f-2312-47d1-94c1-a53946f79885 req-439a5fdf-8d05-4b02-8640-70f171b83f44 service nova] Creating event network-changed:2e10088a-8bb6-4d01-af36-44f371a379a6 for instance 008761e5-2f82-425b-8156-4262dc16ebaa on hv-cinder-85391 Aug 31 04:16:13.479184 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-8969a14f-2312-47d1-94c1-a53946f79885 req-439a5fdf-8d05-4b02-8640-70f171b83f44 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Aug 31 04:16:13.480075 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 485/961] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:16:27.706773 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:27.709114 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:27.711217 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=34 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:27.712247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:27.720801 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:27.721591 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:27.722238 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:27.723310 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:27.724067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:27.724515 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:27.761048 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bb45c30b-4d1a-4786-ae51-714a827310e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058421 Aug 31 04:16:27.761635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 477/962] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:16:27 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:16:27.827668 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:27.828494 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=7 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:27.832727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:27.833451 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:27.840309 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:27.840820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:27.841251 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:27.841937 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:27.842387 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:27.842801 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:27.868362 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:16:27.948455 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6b5fce87-7188-4ea4-a7f7-f3926de21be1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 204 len: 0 microversion: 2.1 time: 0.122191 Aug 31 04:16:27.949036 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 486/963] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:16:27 2022] DELETE /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:16:27.957549 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:27.958604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:27.964994 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:27.965474 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:27.965933 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:27.966607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:27.967086 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:27.967500 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:28.206078 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:28.214597 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ef73fb76-d514-4654-b260-d92686859e1b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1673 microversion: 2.1 time: 0.260903 Aug 31 04:16:28.215228 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 478/964] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:27 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1673 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:29.245930 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:29.247073 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:29.257979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:29.258771 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:29.259541 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:29.260655 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:29.261395 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:29.262060 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:29.474457 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:29.482964 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c3236e73-c280-4da3-9393-00e0b290b9ee tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1673 microversion: 2.1 time: 0.244641 Aug 31 04:16:29.483552 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 487/965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:29 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1673 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:30.504848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:30.505568 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:30.512355 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:30.512844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:30.513280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:30.513983 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:30.514434 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:30.515009 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:30.706645 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:30.715291 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c30b8dea-d80a-481c-8314-9455df683407 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 200 len: 1673 microversion: 2.1 time: 0.214413 Aug 31 04:16:30.716104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 479/966] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:30 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 1673 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:31.071813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-78ef3d6e-b575-4657-a047-defa654cea71 req-d0044987-d3f7-408e-9a4a-d1ce93d87d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907b5ebd-7261-41d9-bfd5-a4f871d87663", "name": "network-vif-deleted", "tag": "90137c1b-a64b-4fe2-ba88-e0e33d96d34a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:16:31.082108 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-78ef3d6e-b575-4657-a047-defa654cea71 req-d0044987-d3f7-408e-9a4a-d1ce93d87d03 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:31.083061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-78ef3d6e-b575-4657-a047-defa654cea71 req-d0044987-d3f7-408e-9a4a-d1ce93d87d03 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:31.083061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-78ef3d6e-b575-4657-a047-defa654cea71 req-d0044987-d3f7-408e-9a4a-d1ce93d87d03 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:31.095245 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-78ef3d6e-b575-4657-a047-defa654cea71 req-d0044987-d3f7-408e-9a4a-d1ce93d87d03 service nova] Creating event network-vif-deleted:90137c1b-a64b-4fe2-ba88-e0e33d96d34a for instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 on hv-cinder-85391 Aug 31 04:16:31.100712 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-78ef3d6e-b575-4657-a047-defa654cea71 req-d0044987-d3f7-408e-9a4a-d1ce93d87d03 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032533 Aug 31 04:16:31.101601 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 488/967] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:16:31.737968 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:31.739072 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:31.748984 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:31.749550 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:31.750040 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:31.750821 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:31.751385 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:31.751884 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:31.766521 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] HTTP exception thrown: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Request method failure captured: Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 HTTP/1.1 Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt_5m1Vu-940gtbvzgUyDd__zs-28U6j3TcgW7K7i_AjUwN0GEXHB40KU6dThJgcXaCxx9a3TPcIbvlvWHB6f__XEisoa96dYnjx0LRtcW7M9XxA38pQuE_UnTuVF2RV24G-pnRLO3qpnPzz87syx_xCXD7msan0cwii8donyeyGnoo Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:16:31.768401 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2f251186d5346d9ae213f018e299cb4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: e29d3d1942614652b3229888d04dc5bf Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:16:31.770176 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '907b5ebd-7261-41d9-bfd5-a4f871d87663'} Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:16:31.771420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:16:31.773235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:16:31.774625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Returning 404 to user: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:16:31.774625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1e5a38b7-0485-41aa-9b87-d2b4cb08bdfc tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 404 len: 111 microversion: 2.1 time: 0.038125 Aug 31 04:16:31.775873 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 480/968] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:31 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:16:31.781579 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b5d4d73-5d78-425a-a8d7-4c7802364ac5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '.version_select at 0x7f88ad3b34c0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:31.805606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0b5d4d73-5d78-425a-a8d7-4c7802364ac5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224399709" status: 202 len: 0 microversion: 2.1 time: 0.028514 Aug 31 04:16:31.806428 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 489/969] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 31 04:16:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224399709 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:16:32.714592 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c095fe71-8d9e-4d5f-822f-d3ddfb17db5b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'create', calling method: .version_select at 0x7f88ad35af70>, body: {"keypair": {"name": "tempest-keypair-76745759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsT3BHmmy+ktISb1/GinjlMucimfopC3xyjvR03HA62n1/xdiPb4J9cISliEgJnbrfwHN8rfv1Cgk8FQZBR28GkPUsTZjR0e+ZCXgf3oPdqUateg8bVjZwUBPn9zCbb2A=="}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:16:32.732924 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-c095fe71-8d9e-4d5f-822f-d3ddfb17db5b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Getting quotas for project b2f251186d5346d9ae213f018e299cb4. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:16:32.736922 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-c095fe71-8d9e-4d5f-822f-d3ddfb17db5b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Getting quotas for user e29d3d1942614652b3229888d04dc5bf and project b2f251186d5346d9ae213f018e299cb4. Resources: {'key_pairs'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:16:32.767248 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c095fe71-8d9e-4d5f-822f-d3ddfb17db5b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.056142 Aug 31 04:16:32.767933 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 481/970] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:16:32 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:16:34.114712 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2098700941", "imageRef": "692c8448-21d7-4ada-bb77-fd8e71089ff3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32e0d3cc-cecf-4072-861e-69e212464544"}], "security_groups": [{"name": "tempest-securitygroup--607049653"}], "key_name": "tempest-keypair-76745759", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:16:34.226637 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] validate_networks() for [('32e0d3cc-cecf-4072-861e-69e212464544', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:16:34.610559 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:16:34.610979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:16:34.611485 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:16:34.611893 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:16:34.612303 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:16:34.622418 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:34.622903 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:34.623370 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:34.624086 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:34.624542 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:34.625016 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:34.642790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Getting quotas for project b2f251186d5346d9ae213f018e299cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:16:34.647383 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Getting quotas for user e29d3d1942614652b3229888d04dc5bf and project b2f251186d5346d9ae213f018e299cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:16:34.658973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:16:34.661674 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='692c8448-21d7-4ada-bb77-fd8e71089ff3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:16:34.711546 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-45112189-a7c7-41d3-80fd-ec1d49c7a6e5 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601985 Aug 31 04:16:34.712168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 490/971] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:16:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:16:34.723638 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-bf7b8b7e-68a4-4d6f-87a6-7b85b0e0142a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:34.724639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-bf7b8b7e-68a4-4d6f-87a6-7b85b0e0142a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:34.782688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-bf7b8b7e-68a4-4d6f-87a6-7b85b0e0142a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:34.790608 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-bf7b8b7e-68a4-4d6f-87a6-7b85b0e0142a tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1236 microversion: 2.1 time: 0.071097 Aug 31 04:16:34.791204 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 482/972] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:34 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:35.812598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:35.813178 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:35.819835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:35.820321 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:35.820769 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:35.821449 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:35.821897 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:35.822312 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:35.901631 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:35.910546 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-34fb2992-fa4e-4b0d-9d03-d096ae3c79e9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1296 microversion: 2.1 time: 0.102590 Aug 31 04:16:35.911862 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 491/973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:35 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:36.933101 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:36.933753 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:36.936376 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:16:36.936530 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Wed Aug 31 04:16:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 (ip 10.222.0.18) !!! Aug 31 04:16:36.948706 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:36.949206 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:36.949634 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:36.950350 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:36.950850 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:36.951351 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:37.216539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:37.224744 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-23d61180-ff74-43f1-850b-0a183105a043 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1361 microversion: 2.1 time: 0.295728 Aug 31 04:16:37.225316 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 483/974] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:36 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:37.382240 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-758a1979-b55c-4faf-9aa3-28d4e7b01d85 req-e1bf5053-e114-4acf-a57c-1671cdb19431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374aa2bf-05c0-49ce-869a-93c3d281dc50", "tag": "7de551fd-c705-4355-b423-65eff826b660"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:16:37.394015 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-758a1979-b55c-4faf-9aa3-28d4e7b01d85 req-e1bf5053-e114-4acf-a57c-1671cdb19431 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:37.394884 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-758a1979-b55c-4faf-9aa3-28d4e7b01d85 req-e1bf5053-e114-4acf-a57c-1671cdb19431 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:37.395601 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-758a1979-b55c-4faf-9aa3-28d4e7b01d85 req-e1bf5053-e114-4acf-a57c-1671cdb19431 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:37.408931 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-758a1979-b55c-4faf-9aa3-28d4e7b01d85 req-e1bf5053-e114-4acf-a57c-1671cdb19431 service nova] Creating event network-changed:7de551fd-c705-4355-b423-65eff826b660 for instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 on hv-cinder-85391 Aug 31 04:16:37.414145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-758a1979-b55c-4faf-9aa3-28d4e7b01d85 req-e1bf5053-e114-4acf-a57c-1671cdb19431 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035901 Aug 31 04:16:37.414732 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 492/975] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:16:38.250771 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:38.251872 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:38.263638 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:38.264461 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:38.265189 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:38.266359 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:38.267109 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:38.267841 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:38.415362 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:38.427218 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7201a925-4edf-41e9-b353-1d28ccfddb0c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1361 microversion: 2.1 time: 0.183313 Aug 31 04:16:38.427790 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 484/976] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:38 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:39.449695 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:39.450357 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:39.456878 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:39.457366 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:39.457801 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:39.458488 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:39.459357 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:39.459781 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:39.631066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:39.639436 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e4691dd3-ab71-4706-9d90-cef56c11eed4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1361 microversion: 2.1 time: 0.194456 Aug 31 04:16:39.639982 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 493/977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:39 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:40.664642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:40.665522 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:40.676414 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:40.677209 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:40.678313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:40.679008 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:40.679488 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:40.679911 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:40.828334 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:40.836724 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1e0c7ef4-c945-4b14-9c01-ebd1c8277eae tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1361 microversion: 2.1 time: 0.178967 Aug 31 04:16:40.837319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 485/978] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:40 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:41.865242 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:41.866040 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:41.872940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:41.873392 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:41.873823 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:41.874520 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:41.874972 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:41.875424 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:42.003810 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:42.011636 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0ad3cf01-6219-4440-8f01-4546506332ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1361 microversion: 2.1 time: 0.153007 Aug 31 04:16:42.012214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 494/979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:41 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:43.033253 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:43.033908 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:43.040807 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:43.041291 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:43.041722 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:43.042403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:43.042852 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:43.043299 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:43.184306 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:43.191864 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-275228d9-a176-4af6-92cf-c06a905b9f75 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1361 microversion: 2.1 time: 0.162615 Aug 31 04:16:43.192428 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 486/980] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:43 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:43.254261 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-b8ab0568-a0c0-48aa-b437-937bd9797abc req-60b4c017-c8b4-435b-ba65-ecc81a1f0ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374aa2bf-05c0-49ce-869a-93c3d281dc50", "name": "network-vif-plugged", "status": "completed", "tag": "7de551fd-c705-4355-b423-65eff826b660"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:16:43.264950 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b8ab0568-a0c0-48aa-b437-937bd9797abc req-60b4c017-c8b4-435b-ba65-ecc81a1f0ceb service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:43.265509 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b8ab0568-a0c0-48aa-b437-937bd9797abc req-60b4c017-c8b4-435b-ba65-ecc81a1f0ceb service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:43.266048 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b8ab0568-a0c0-48aa-b437-937bd9797abc req-60b4c017-c8b4-435b-ba65-ecc81a1f0ceb service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:43.279793 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-b8ab0568-a0c0-48aa-b437-937bd9797abc req-60b4c017-c8b4-435b-ba65-ecc81a1f0ceb service nova] Creating event network-vif-plugged:7de551fd-c705-4355-b423-65eff826b660 for instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 on hv-cinder-85391 Aug 31 04:16:43.285145 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-b8ab0568-a0c0-48aa-b437-937bd9797abc req-60b4c017-c8b4-435b-ba65-ecc81a1f0ceb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034597 Aug 31 04:16:43.285844 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 495/981] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:16:44.217830 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:44.218523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:44.225747 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:44.226347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:44.227188 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:44.227901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:44.228336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:44.228753 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:44.365780 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:44.374357 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d25cdc3f-2444-428a-a2bd-53aa7d5057f4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1361 microversion: 2.1 time: 0.162554 Aug 31 04:16:44.374921 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 487/982] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:44 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:45.405063 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:45.406157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:45.413426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:45.414315 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:45.421392 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:45.421861 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:45.422286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:45.422973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:45.423470 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:45.423883 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:45.566899 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:16:45.579394 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0739101b-0243-401b-a731-27e63e0c4cda tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1546 microversion: 2.1 time: 0.176743 Aug 31 04:16:45.580239 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 496/983] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:16:45 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:16:45.600432 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:16:45.600987 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:16:45.603201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=6 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:45.609420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:45.609899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:45.610327 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:45.610995 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:45.611496 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:45.611918 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:45.697120 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-014e6dbd-a744-43ff-bd1f-02ab9bf7ecf1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100338 Aug 31 04:16:45.698000 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 488/984] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 31 04:16:45 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:16:46.701375 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-329dd5ac-f923-4784-8926-50388401ee8d req-91074ef3-2e22-46f8-807c-7102265ea41d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374aa2bf-05c0-49ce-869a-93c3d281dc50", "tag": "7de551fd-c705-4355-b423-65eff826b660"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:16:46.711671 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-329dd5ac-f923-4784-8926-50388401ee8d req-91074ef3-2e22-46f8-807c-7102265ea41d service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:16:46.712138 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-329dd5ac-f923-4784-8926-50388401ee8d req-91074ef3-2e22-46f8-807c-7102265ea41d service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:16:46.712558 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-329dd5ac-f923-4784-8926-50388401ee8d req-91074ef3-2e22-46f8-807c-7102265ea41d service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:16:46.723469 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-329dd5ac-f923-4784-8926-50388401ee8d req-91074ef3-2e22-46f8-807c-7102265ea41d service nova] Creating event network-changed:7de551fd-c705-4355-b423-65eff826b660 for instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 on hv-cinder-85391 Aug 31 04:16:46.728935 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-329dd5ac-f923-4784-8926-50388401ee8d req-91074ef3-2e22-46f8-807c-7102265ea41d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031327 Aug 31 04:16:46.729776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 497/985] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:22.851978 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:22.853576 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=54 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:22.861607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:22.862403 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:22.870354 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:22.870837 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:22.871293 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:22.871971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:22.872412 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:22.872826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:22.898203 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f7991f31-fc05-4f4b-ab44-c4b79fbc85f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/ips" status: 200 len: 145 microversion: 2.1 time: 0.049420 Aug 31 04:17:22.898757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 489/986] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 31 04:17:22 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:24.261205 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:24.261940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:24.266625 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c6a0874-dd45-4c46-8bc9-7cde43a086b1"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:17:24.269114 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:24.277179 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:24.277658 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:24.278091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:24.278777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:24.279256 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:24.279672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:24.545421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f6f5b814-57a8-48b5-801a-204875ec98ac tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285708 Aug 31 04:17:24.547177 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 498/987] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:17:24 2022] POST /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:31.062610 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:31.064796 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:31.072231 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:31.072715 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:31.073192 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:31.073901 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:31.074348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:31.074762 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:31.113122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-4a4c8ed5-41d1-43c4-abec-410c2eb557e3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054435 Aug 31 04:17:31.114006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 490/988] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:17:31 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:31.126253 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:31.126803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:31.133815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:31.134329 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:31.134765 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:31.135501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:31.135963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:31.136394 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:31.166803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2dd0cf92-e81f-4072-9189-60f7032759b1 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/2c6a0874-dd45-4c46-8bc9-7cde43a086b1" status: 200 len: 194 microversion: 2.1 time: 0.045356 Aug 31 04:17:31.167431 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 499/989] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 31 04:17:31 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/2c6a0874-dd45-4c46-8bc9-7cde43a086b1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:32.536437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e9543b3-e961-46a0-910a-cf15ec9f53bd"}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:17:32.538749 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:32.545671 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:32.546082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:32.546492 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:32.547247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:32.547697 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:32.548126 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:32.803898 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-b7533322-a218-47c4-8b29-af43426a7da6 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "POST /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271193 Aug 31 04:17:32.804436 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 491/990] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 31 04:17:32 2022] POST /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:40.385598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:40.387962 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:40.394870 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:40.395381 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:40.395814 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:40.396500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:40.396949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:40.397361 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:40.428152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7f3aba38-8ad6-4825-ba21-77643a8e6634 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046738 Aug 31 04:17:40.428701 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 500/991] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:17:40 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:17:40.580365 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:40.581074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:40.590462 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:40.591313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:40.591963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:40.593045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:40.593691 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:40.594325 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:40.631040 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a439af47-a28f-4793-80a0-71f04f32662b tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/2c6a0874-dd45-4c46-8bc9-7cde43a086b1" status: 200 len: 194 microversion: 2.1 time: 0.056067 Aug 31 04:17:40.631690 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 492/992] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 31 04:17:40 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/2c6a0874-dd45-4c46-8bc9-7cde43a086b1 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:40.645168 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:40.645952 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:40.655207 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:40.655685 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:40.656113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:40.656794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:40.657237 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:40.657653 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:40.744123 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lazy-loading 'services' on Instance uuid 374aa2bf-05c0-49ce-869a-93c3d281dc50 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:17:40.819019 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d6ba9d0-5214-4802-b125-51079e5e8032 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/2c6a0874-dd45-4c46-8bc9-7cde43a086b1" status: 202 len: 0 microversion: 2.1 time: 0.178687 Aug 31 04:17:40.819786 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 501/993] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:17:40 2022] DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/2c6a0874-dd45-4c46-8bc9-7cde43a086b1 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:17:41.941191 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:41.941761 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:41.948200 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:41.948676 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:41.949110 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:41.949790 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:41.950368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:41.951063 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:41.982652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ba1c3e90-8591-4ed2-99b3-847a208a3a7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/9e9543b3-e961-46a0-910a-cf15ec9f53bd" status: 200 len: 194 microversion: 2.1 time: 0.045416 Aug 31 04:17:41.983280 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 493/994] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 31 04:17:41 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/9e9543b3-e961-46a0-910a-cf15ec9f53bd => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:41.997781 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:41.998298 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:42.005940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:42.006413 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:42.006837 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:42.007554 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:42.008003 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:42.008415 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:42.098646 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lazy-loading 'services' on Instance uuid 374aa2bf-05c0-49ce-869a-93c3d281dc50 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:17:42.180490 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1e24f637-7d92-4791-a001-0d80e6032433 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/9e9543b3-e961-46a0-910a-cf15ec9f53bd" status: 202 len: 0 microversion: 2.1 time: 0.189854 Aug 31 04:17:42.181084 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 502/995] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 31 04:17:41 2022] DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments/9e9543b3-e961-46a0-910a-cf15ec9f53bd => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:17:43.360594 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:43.362850 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:43.369728 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:43.370212 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:43.370642 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:43.371384 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:43.371834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:43.372258 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:43.401787 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-1a8c3b05-3896-4409-b286-0bde1970564e tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045165 Aug 31 04:17:43.402363 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 494/996] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:17:43 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:17:43.526399 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:43.528675 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:43.535426 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:43.535895 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:43.536322 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:43.537026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:43.537469 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:43.537887 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:43.566889 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7740d671-0253-4d25-b878-3b0c40b70f45 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045326 Aug 31 04:17:43.567474 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 503/997] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 31 04:17:43 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 04:17:43.632020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:43.632505 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:43.640534 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:43.641254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:43.641900 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:43.642930 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:43.643617 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:43.644251 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:43.681393 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:17:43.770883 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e25324ad-5d0b-45cf-9ef6-172fb09afb7c tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 204 len: 0 microversion: 2.1 time: 0.142307 Aug 31 04:17:43.771966 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 495/998] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:17:43 2022] DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:17:43.780629 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:43.781508 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:43.787690 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:43.788181 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:43.788617 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:43.789305 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:43.789794 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:43.790224 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:43.928709 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:17:43.942129 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2e332f3a-ab97-44cd-b027-7d910e3bd096 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1671 microversion: 2.1 time: 0.165356 Aug 31 04:17:43.942979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 504/999] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:17:43 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:17:44.969463 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:44.970118 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:44.977405 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:44.978254 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:44.978675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:44.979409 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:44.979852 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:44.980250 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:45.134406 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:17:45.142557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-993f7f2f-0a01-4347-8670-67f1200a72b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1671 microversion: 2.1 time: 0.178110 Aug 31 04:17:45.143183 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 496/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:17:44 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1671 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:17:46.164346 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:46.164945 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:46.171889 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:46.172403 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:46.172834 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:46.173555 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:46.174005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:46.174429 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:46.241863 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29d3d1942614652b3229888d04dc5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f251186d5346d9ae213f018e299cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:17:46.258797 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f5c92730-c802-4586-af28-8e5e57fb6fb9 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 200 len: 1604 microversion: 2.1 time: 0.089668 Aug 31 04:17:46.259448 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 505/1001] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:17:46 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:17:46.376900 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-b80b5abf-a6ee-49d6-ad7a-8156856377de req-9004a3a2-0a00-4ce3-9e9b-d7839a461c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374aa2bf-05c0-49ce-869a-93c3d281dc50", "name": "network-vif-deleted", "tag": "7de551fd-c705-4355-b423-65eff826b660"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:17:46.387068 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b80b5abf-a6ee-49d6-ad7a-8156856377de req-9004a3a2-0a00-4ce3-9e9b-d7839a461c4f service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:46.387539 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b80b5abf-a6ee-49d6-ad7a-8156856377de req-9004a3a2-0a00-4ce3-9e9b-d7839a461c4f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:46.387958 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b80b5abf-a6ee-49d6-ad7a-8156856377de req-9004a3a2-0a00-4ce3-9e9b-d7839a461c4f service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:46.406109 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-b80b5abf-a6ee-49d6-ad7a-8156856377de req-9004a3a2-0a00-4ce3-9e9b-d7839a461c4f service nova] Creating event network-vif-deleted:7de551fd-c705-4355-b423-65eff826b660 for instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 on hv-cinder-85391 Aug 31 04:17:46.412492 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-b80b5abf-a6ee-49d6-ad7a-8156856377de req-9004a3a2-0a00-4ce3-9e9b-d7839a461c4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109833 Aug 31 04:17:46.414458 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 497/1002] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:17:47.280920 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:47.281778 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:47.288522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:47.289018 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:47.289456 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:47.290157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:47.290609 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:47.291062 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:47.304915 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] HTTP exception thrown: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Request method failure captured: Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 HTTP/1.1 Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt_5m1Vu-940gtbvzgUyDd__zs-28U6j3TcgW7K7i_AjUwN0GEXHB40KU6dThJgcXaCxx9a3TPcIbvlvWHB6f__XEisoa96dYnjx0LRtcW7M9XxA38pQuE_UnTuVF2RV24G-pnRLO3qpnPzz87syx_xCXD7msan0cwii8donyeyGnoo Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:17:47.306644 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2f251186d5346d9ae213f018e299cb4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: e29d3d1942614652b3229888d04dc5bf Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:47.308289 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '374aa2bf-05c0-49ce-869a-93c3d281dc50'} Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:17:47.309196 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:47.311141 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:47.312777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Returning 404 to user: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:17:47.312777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1693be05-4645-4a03-953b-bf448ca1f640 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 404 len: 111 microversion: 2.1 time: 0.031294 Aug 31 04:17:47.312777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 506/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:17:47 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:17:47.320045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-c2202dde-f9dd-4f01-88d9-116c7dae35f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '.version_select at 0x7f88ad394280>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:47.341624 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-c2202dde-f9dd-4f01-88d9-116c7dae35f3 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76745759" status: 202 len: 0 microversion: 2.1 time: 0.027664 Aug 31 04:17:47.342217 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 498/1004] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Aug 31 04:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76745759 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:17:50.292285 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:50.292776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:50.299809 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:50.300340 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:50.300798 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:50.301463 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:50.301912 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:50.302333 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:50.316117 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] HTTP exception thrown: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Request method failure captured: Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 HTTP/1.1 Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt_5m1Vu-940gtbvzgUyDd__zs-28U6j3TcgW7K7i_AjUwN0GEXHB40KU6dThJgcXaCxx9a3TPcIbvlvWHB6f__XEisoa96dYnjx0LRtcW7M9XxA38pQuE_UnTuVF2RV24G-pnRLO3qpnPzz87syx_xCXD7msan0cwii8donyeyGnoo Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:17:50.317660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2f251186d5346d9ae213f018e299cb4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: e29d3d1942614652b3229888d04dc5bf Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.319380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '374aa2bf-05c0-49ce-869a-93c3d281dc50'} Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:17:50.320318 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.321900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.323556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Returning 404 to user: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:17:50.323556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0b6028d9-7ed2-439d-9a76-775f096b4c25 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 404 len: 111 microversion: 2.1 time: 0.030673 Aug 31 04:17:50.323556 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 507/1005] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:17:50 2022] DELETE /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:17:50.328066 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:50.328818 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 374aa2bf-05c0-49ce-869a-93c3d281dc50] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:50.335858 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:50.336333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:50.336754 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:50.337433 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:50.337876 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:50.338291 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:50.351690 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] HTTP exception thrown: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Request method failure captured: Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 HTTP/1.1 Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt_5m1Vu-940gtbvzgUyDd__zs-28U6j3TcgW7K7i_AjUwN0GEXHB40KU6dThJgcXaCxx9a3TPcIbvlvWHB6f__XEisoa96dYnjx0LRtcW7M9XxA38pQuE_UnTuVF2RV24G-pnRLO3qpnPzz87syx_xCXD7msan0cwii8donyeyGnoo Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:17:50.353621 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2f251186d5346d9ae213f018e299cb4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: e29d3d1942614652b3229888d04dc5bf Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.355532 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '374aa2bf-05c0-49ce-869a-93c3d281dc50'} Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:17:50.356420 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. Aug 31 04:17:50.357899 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:50.359234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Returning 404 to user: Instance 374aa2bf-05c0-49ce-869a-93c3d281dc50 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:17:50.359234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-a4586511-883b-4b4b-b6e9-2f856ba775b4 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50" status: 404 len: 111 microversion: 2.1 time: 0.031319 Aug 31 04:17:50.359234 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 499/1006] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:17:50 2022] GET /compute/v2.1/servers/374aa2bf-05c0-49ce-869a-93c3d281dc50 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:17:51.516653 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:51.517179 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:51.524157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:51.524637 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:51.525065 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:51.525777 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:51.526222 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:51.526639 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:51.543499 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] HTTP exception thrown: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Request method failure captured: Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 HTTP/1.1 Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt_5m1Vu-940gtbvzgUyDd__zs-28U6j3TcgW7K7i_AjUwN0GEXHB40KU6dThJgcXaCxx9a3TPcIbvlvWHB6f__XEisoa96dYnjx0LRtcW7M9XxA38pQuE_UnTuVF2RV24G-pnRLO3qpnPzz87syx_xCXD7msan0cwii8donyeyGnoo Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:17:51.544963 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2f251186d5346d9ae213f018e299cb4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: e29d3d1942614652b3229888d04dc5bf Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.546598 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': '907b5ebd-7261-41d9-bfd5-a4f871d87663'} Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:17:51.547649 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.549158 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.550723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Returning 404 to user: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:17:51.550723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-af3eefce-12c4-42b1-aebc-d27dc6362aeb tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 404 len: 111 microversion: 2.1 time: 0.033751 Aug 31 04:17:51.550723 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 508/1007] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:17:51 2022] DELETE /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:17:51.556224 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:51.556844 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] [instance: 907b5ebd-7261-41d9-bfd5-a4f871d87663] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:51.563554 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:51.564043 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:51.564476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:51.565164 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:51.565616 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:51.566040 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:51.579730 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] HTTP exception thrown: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Request method failure captured: Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 HTTP/1.1 Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt_5m1Vu-940gtbvzgUyDd__zs-28U6j3TcgW7K7i_AjUwN0GEXHB40KU6dThJgcXaCxx9a3TPcIbvlvWHB6f__XEisoa96dYnjx0LRtcW7M9XxA38pQuE_UnTuVF2RV24G-pnRLO3qpnPzz87syx_xCXD7msan0cwii8donyeyGnoo Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:17:51.581225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2f251186d5346d9ae213f018e299cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2f251186d5346d9ae213f018e299cb4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: b2f251186d5346d9ae213f018e299cb4 Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1038023518 Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: e29d3d1942614652b3229888d04dc5bf Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-AttachVolumeTestJSON-1038023518-project Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.582814 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '907b5ebd-7261-41d9-bfd5-a4f871d87663'} Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:17:51.585046 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. Aug 31 04:17:51.586537 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:17:51.588541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] Returning 404 to user: Instance 907b5ebd-7261-41d9-bfd5-a4f871d87663 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:17:51.588541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-da9be3be-710f-4519-a199-94026e380773 tempest-AttachVolumeTestJSON-1038023518 tempest-AttachVolumeTestJSON-1038023518-project] 10.222.0.18 "GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663" status: 404 len: 111 microversion: 2.1 time: 0.030417 Aug 31 04:17:51.588541 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 500/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:17:51 2022] GET /compute/v2.1/servers/907b5ebd-7261-41d9-bfd5-a4f871d87663 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:17:57.332562 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:57.333187 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-e2dcfa1d-098c-41d9-9a5c-73884e77e86a req-abf2e5f6-4ec1-4d95-b14a-4c0a2d4475ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008761e5-2f82-425b-8156-4262dc16ebaa", "tag": "2e10088a-8bb6-4d01-af36-44f371a379a6"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:17:57.333606 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:57.338691 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:57.341363 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=23 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:57.343743 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:57.344528 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:57.345565 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-e2dcfa1d-098c-41d9-9a5c-73884e77e86a req-abf2e5f6-4ec1-4d95-b14a-4c0a2d4475ba service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:57.346099 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:57.346375 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-e2dcfa1d-098c-41d9-9a5c-73884e77e86a req-abf2e5f6-4ec1-4d95-b14a-4c0a2d4475ba service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:57.346818 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:57.347171 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-e2dcfa1d-098c-41d9-9a5c-73884e77e86a req-abf2e5f6-4ec1-4d95-b14a-4c0a2d4475ba service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:57.347941 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:57.348694 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:57.355314 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:57.363235 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-e2dcfa1d-098c-41d9-9a5c-73884e77e86a req-abf2e5f6-4ec1-4d95-b14a-4c0a2d4475ba service nova] Creating event network-changed:2e10088a-8bb6-4d01-af36-44f371a379a6 for instance 008761e5-2f82-425b-8156-4262dc16ebaa on hv-cinder-85391 Aug 31 04:17:57.369467 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-e2dcfa1d-098c-41d9-9a5c-73884e77e86a req-abf2e5f6-4ec1-4d95-b14a-4c0a2d4475ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040692 Aug 31 04:17:57.370429 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 501/1009] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 04:17:57.372475 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:57.385248 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:17:57.495319 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f6a4f655-b0e2-46c5-8907-9bdb33a0ce83 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "DELETE /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 204 len: 0 microversion: 2.1 time: 0.167722 Aug 31 04:17:57.500592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 509/1010] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:17:57 2022] DELETE /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:17:57.506313 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:57.507200 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:57.517858 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:57.521337 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:57.522842 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:57.523838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:57.526035 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:57.526540 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:57.680174 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:17:57.690487 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-f21c8661-4bb0-4383-a9a6-d8c65fd13427 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1579 microversion: 2.1 time: 0.188550 Aug 31 04:17:57.691604 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 502/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:17:57 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1579 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:17:58.713159 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:17:58.713856 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:17:58.720805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:58.721297 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:58.721785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:58.722500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:58.723002 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:58.723511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:59.145419 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:17:59.153527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b4e95cd6-ecce-4453-8ab5-6c693509c793 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1579 microversion: 2.1 time: 0.444725 Aug 31 04:17:59.154349 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 510/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:17:58 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1579 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:17:59.665225 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-15ecf80b-c031-42bb-a900-053d4ccddb46 req-662e8a5f-1e6a-483b-95ad-cea11be983d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008761e5-2f82-425b-8156-4262dc16ebaa", "name": "network-vif-deleted", "tag": "2e10088a-8bb6-4d01-af36-44f371a379a6"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:17:59.675198 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-15ecf80b-c031-42bb-a900-053d4ccddb46 req-662e8a5f-1e6a-483b-95ad-cea11be983d4 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:17:59.676066 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-15ecf80b-c031-42bb-a900-053d4ccddb46 req-662e8a5f-1e6a-483b-95ad-cea11be983d4 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:17:59.676197 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-15ecf80b-c031-42bb-a900-053d4ccddb46 req-662e8a5f-1e6a-483b-95ad-cea11be983d4 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:17:59.688153 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-15ecf80b-c031-42bb-a900-053d4ccddb46 req-662e8a5f-1e6a-483b-95ad-cea11be983d4 service nova] Creating event network-vif-deleted:2e10088a-8bb6-4d01-af36-44f371a379a6 for instance 008761e5-2f82-425b-8156-4262dc16ebaa on hv-cinder-85391 Aug 31 04:17:59.693471 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-15ecf80b-c031-42bb-a900-053d4ccddb46 req-662e8a5f-1e6a-483b-95ad-cea11be983d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032358 Aug 31 04:17:59.694419 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 503/1013] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:18:00.175770 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:00.176282 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:00.183276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:00.183759 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:00.184182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:00.184917 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:00.185691 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:00.186106 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:00.223638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:00.224135 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:00.224577 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:00.225020 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lazy-loading 'fault' on Instance uuid 008761e5-2f82-425b-8156-4262dc16ebaa {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:18:00.270616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:18:00.279755 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2e7eaa73-5323-452f-949c-d354157b86e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 200 len: 1230 microversion: 2.1 time: 0.107788 Aug 31 04:18:00.281575 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 511/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:00 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:18:01.304054 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:01.304759 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: 008761e5-2f82-425b-8156-4262dc16ebaa] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:01.312213 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:01.312693 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:01.313150 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:01.313839 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:01.314292 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:01.314711 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:01.329941 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] HTTP exception thrown: Instance 008761e5-2f82-425b-8156-4262dc16ebaa could not be found. Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Request method failure captured: Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa HTTP/1.1 Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt9IqK30Ffii3LsXP7lT-rclhmhWfQbZzp78OkRwktqgo8sdzltIWvdsVAQjiFdJJO2VZTLbFWbi0i97ZWRYn13LNN1JnW3L_c6JMhUhoR11j7zaWzaaOhYHGAAuOE3fHr7vUTr5cDX4e77ohi8xUDI2c7sy3M7lmjUK0hDcMrXUOmU Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:18:01.331732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e6db5b66c75c499d98d02d6e0041299f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 62f5d4659eea4d91a689d709460396d2 Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance 008761e5-2f82-425b-8156-4262dc16ebaa could not be found. Aug 31 04:18:01.333441 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': '008761e5-2f82-425b-8156-4262dc16ebaa'} Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008761e5-2f82-425b-8156-4262dc16ebaa could not be found. Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:18:01.334494 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008761e5-2f82-425b-8156-4262dc16ebaa could not be found. Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008761e5-2f82-425b-8156-4262dc16ebaa could not be found. Aug 31 04:18:01.336104 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:01.337472 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Returning 404 to user: Instance 008761e5-2f82-425b-8156-4262dc16ebaa could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:18:01.337472 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7df1cd24-8f09-4d92-9eb4-370a02eb4130 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa" status: 404 len: 111 microversion: 2.1 time: 0.037629 Aug 31 04:18:01.337639 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 504/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:01 2022] GET /compute/v2.1/servers/008761e5-2f82-425b-8156-4262dc16ebaa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:18:04.488446 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:04.495521 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:04.503216 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:04.503785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:04.504286 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:04.505272 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:04.506004 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:04.506669 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:04.537032 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:18:04.629819 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-44b65562-98f7-46ae-acb3-391cd505dab1 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 204 len: 0 microversion: 2.1 time: 0.145404 Aug 31 04:18:04.631179 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 512/1016] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:18:04 2022] DELETE /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:18:04.641481 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:04.642182 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:04.646480 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-b8763f56-7b35-4580-a5de-7aa350e6368f req-02381461-8ca9-49c2-92da-d9332ddefa24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f732c2-506d-4871-825e-2672cb8a2452", "tag": "cec5d875-c053-4ef2-a631-7779726cb122"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:18:04.648667 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:04.649008 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:04.649464 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:04.650143 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:04.650605 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:04.651078 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:04.658740 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b8763f56-7b35-4580-a5de-7aa350e6368f req-02381461-8ca9-49c2-92da-d9332ddefa24 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:04.659332 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b8763f56-7b35-4580-a5de-7aa350e6368f req-02381461-8ca9-49c2-92da-d9332ddefa24 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:04.659834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b8763f56-7b35-4580-a5de-7aa350e6368f req-02381461-8ca9-49c2-92da-d9332ddefa24 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:04.674946 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-b8763f56-7b35-4580-a5de-7aa350e6368f req-02381461-8ca9-49c2-92da-d9332ddefa24 service nova] Creating event network-changed:cec5d875-c053-4ef2-a631-7779726cb122 for instance d0f732c2-506d-4871-825e-2672cb8a2452 on hv-cinder-85391 Aug 31 04:18:04.680662 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-b8763f56-7b35-4580-a5de-7aa350e6368f req-02381461-8ca9-49c2-92da-d9332ddefa24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190387 Aug 31 04:18:04.681688 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 505/1017] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:18:04.784045 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:18:04.792266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4343b618-abc9-4828-af8c-a9d7c283086c tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1578 microversion: 2.1 time: 0.155793 Aug 31 04:18:04.792934 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 513/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:04 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:18:05.814086 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:05.814669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:05.821837 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:05.822319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:05.822747 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:05.823468 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:05.823914 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:05.824333 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:05.968508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:18:05.981274 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-0d79957e-e8ce-4550-8820-921898c2848d tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1578 microversion: 2.1 time: 0.171597 Aug 31 04:18:05.982000 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 506/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:05 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:18:07.010671 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:07.011651 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:07.022398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:07.023255 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:07.024162 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:07.025072 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:07.025527 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:07.025944 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:07.172373 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:18:07.180261 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-72460bcf-14f3-4bd1-8a69-e5204d7229bd tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1578 microversion: 2.1 time: 0.176625 Aug 31 04:18:07.180848 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 514/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:07 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:18:08.201888 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:08.202476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:08.209523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:08.210011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:08.210446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:08.211174 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:08.212093 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:08.212617 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:08.392322 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:18:08.401808 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-6a3b1a61-f18e-412c-aa70-4a98bff76816 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1578 microversion: 2.1 time: 0.203693 Aug 31 04:18:08.402627 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 507/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:08 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:18:09.366786 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-0ab7ef82-491b-4070-8c58-15678d0f8f1c req-1a484b40-81ff-4df8-a773-5b6605ea3534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f732c2-506d-4871-825e-2672cb8a2452", "name": "network-vif-deleted", "tag": "cec5d875-c053-4ef2-a631-7779726cb122"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:18:09.377440 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0ab7ef82-491b-4070-8c58-15678d0f8f1c req-1a484b40-81ff-4df8-a773-5b6605ea3534 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:09.378000 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0ab7ef82-491b-4070-8c58-15678d0f8f1c req-1a484b40-81ff-4df8-a773-5b6605ea3534 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:09.378421 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0ab7ef82-491b-4070-8c58-15678d0f8f1c req-1a484b40-81ff-4df8-a773-5b6605ea3534 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:09.390438 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-0ab7ef82-491b-4070-8c58-15678d0f8f1c req-1a484b40-81ff-4df8-a773-5b6605ea3534 service nova] Creating event network-vif-deleted:cec5d875-c053-4ef2-a631-7779726cb122 for instance d0f732c2-506d-4871-825e-2672cb8a2452 on hv-cinder-85391 Aug 31 04:18:09.397276 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-0ab7ef82-491b-4070-8c58-15678d0f8f1c req-1a484b40-81ff-4df8-a773-5b6605ea3534 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034245 Aug 31 04:18:09.398157 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 515/1022] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:18:09.423835 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:09.425079 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:09.432837 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:09.433343 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:09.433771 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:09.434637 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:09.435208 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:09.435635 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:09.499020 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5d4659eea4d91a689d709460396d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6db5b66c75c499d98d02d6e0041299f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:18:09.508580 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-18713841-8fe3-40cc-8055-79ca0034933e tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 200 len: 1225 microversion: 2.1 time: 0.089089 Aug 31 04:18:09.509150 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 508/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:09 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:18:10.533501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:10.534295 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d0f732c2-506d-4871-825e-2672cb8a2452] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:10.542136 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:10.542698 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:10.543305 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:10.544116 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:10.544672 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:10.545137 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:10.560888 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] HTTP exception thrown: Instance d0f732c2-506d-4871-825e-2672cb8a2452 could not be found. Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Request method failure captured: Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 HTTP/1.1 Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt9IqK30Ffii3LsXP7lT-rclhmhWfQbZzp78OkRwktqgo8sdzltIWvdsVAQjiFdJJO2VZTLbFWbi0i97ZWRYn13LNN1JnW3L_c6JMhUhoR11j7zaWzaaOhYHGAAuOE3fHr7vUTr5cDX4e77ohi8xUDI2c7sy3M7lmjUK0hDcMrXUOmU Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:18:10.562511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e6db5b66c75c499d98d02d6e0041299f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 62f5d4659eea4d91a689d709460396d2 Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance d0f732c2-506d-4871-825e-2672cb8a2452 could not be found. Aug 31 04:18:10.564148 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'd0f732c2-506d-4871-825e-2672cb8a2452'} Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f732c2-506d-4871-825e-2672cb8a2452 could not be found. Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:18:10.565091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f732c2-506d-4871-825e-2672cb8a2452 could not be found. Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f732c2-506d-4871-825e-2672cb8a2452 could not be found. Aug 31 04:18:10.566908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:10.568501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Returning 404 to user: Instance d0f732c2-506d-4871-825e-2672cb8a2452 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:18:10.568501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e24c9c2f-d3e6-480e-aa93-48d7e0553f14 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452" status: 404 len: 111 microversion: 2.1 time: 0.036067 Aug 31 04:18:10.568501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 516/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:10 2022] GET /compute/v2.1/servers/d0f732c2-506d-4871-825e-2672cb8a2452 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:18:11.022971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:11.023525 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:11.030348 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:11.030837 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:11.031299 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:11.032004 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:11.032450 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:11.032841 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:11.047070 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.wsgi [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] HTTP exception thrown: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Request method failure captured: Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: request: DELETE /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 HTTP/1.1 Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept: application/json Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Accept-Encoding: identity Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Connection: close Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Length: 0 Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Content-Type: application/json Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Host: 10.222.0.18 Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Openstack-System-Scope: None Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: User-Agent: python-urllib3/1.26.12 Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Auth-Token: gAAAAABjDt9IqK30Ffii3LsXP7lT-rclhmhWfQbZzp78OkRwktqgo8sdzltIWvdsVAQjiFdJJO2VZTLbFWbi0i97ZWRYn13LNN1JnW3L_c6JMhUhoR11j7zaWzaaOhYHGAAuOE3fHr7vUTr5cDX4e77ohi8xUDI2c7sy3M7lmjUK0hDcMrXUOmU Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Id: None Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Domain-Name: None Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Identity-Status: Confirmed Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Is-Admin-Project: True Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Id: default Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Domain-Name: Default Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Project-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Role: reader,member Aug 31 04:18:11.048784 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Roles: reader,member Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e6db5b66c75c499d98d02d6e0041299f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-Tenant-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Id: default Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Domain-Name: Default Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Id: 62f5d4659eea4d91a689d709460396d2 Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: X-User-Name: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: method: > Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: exception: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.050367 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: action_args: {'id': 'd1d85740-5090-4429-a8fb-61391968c231'} Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:18:11.051507 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.053100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.054739 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Returning 404 to user: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. {{(pid=120661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:18:11.054739 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-26305e76-ce8c-4580-b4af-f621549fc862 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 404 len: 111 microversion: 2.1 time: 0.031265 Aug 31 04:18:11.054739 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 509/1025] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:18:11 2022] DELETE /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:18:11.068080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:11.068717 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] [instance: d1d85740-5090-4429-a8fb-61391968c231] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:18:11.075769 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:11.076263 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:11.076697 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:11.077394 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:18:11.077907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:18:11.078332 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:18:11.092494 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] HTTP exception thrown: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Request method failure captured: Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 HTTP/1.1 Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDt9IqK30Ffii3LsXP7lT-rclhmhWfQbZzp78OkRwktqgo8sdzltIWvdsVAQjiFdJJO2VZTLbFWbi0i97ZWRYn13LNN1JnW3L_c6JMhUhoR11j7zaWzaaOhYHGAAuOE3fHr7vUTr5cDX4e77ohi8xUDI2c7sy3M7lmjUK0hDcMrXUOmU Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:18:11.094082 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e6db5b66c75c499d98d02d6e0041299f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e6db5b66c75c499d98d02d6e0041299f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: e6db5b66c75c499d98d02d6e0041299f Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestVolumeBootPattern-1535167288 Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: 62f5d4659eea4d91a689d709460396d2 Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestVolumeBootPattern-1535167288-project Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.095783 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'd1d85740-5090-4429-a8fb-61391968c231'} Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:18:11.096832 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. Aug 31 04:18:11.098359 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:18:11.100039 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Returning 404 to user: Instance d1d85740-5090-4429-a8fb-61391968c231 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:18:11.100039 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c1a6065d-77a2-487d-9f4e-69c23995c8e7 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231" status: 404 len: 111 microversion: 2.1 time: 0.031539 Aug 31 04:18:11.100039 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 517/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:18:11 2022] GET /compute/v2.1/servers/d1d85740-5090-4429-a8fb-61391968c231 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:18:12.454654 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9df304aa-10d8-4e2d-aed6-d900b7c40682 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] Calling method '.version_select at 0x7f88ad4094c0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:18:12.486859 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9df304aa-10d8-4e2d-aed6-d900b7c40682 tempest-TestVolumeBootPattern-1535167288 tempest-TestVolumeBootPattern-1535167288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1423806456" status: 202 len: 0 microversion: 2.1 time: 0.036105 Aug 31 04:18:12.493737 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 510/1027] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Aug 31 04:18:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1423806456 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:19:35.921839 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:19:35.922435 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Wed Aug 31 04:19:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Aug 31 04:19:35.923172 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:19:35.924496 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:19:35.925266 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:19:35.925522 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Wed Aug 31 04:19:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Aug 31 04:19:36.119798 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-089cf733-5461-4cba-ad21-03e9203bd9bb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Action: 'create', calling method: .version_select at 0x7f88ad6c1550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1964917460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7gF8pKsd6Oo1WedLcxPTff0cVl9hB7vx83/R+43KiYgqhlumJeSCU6scgZzi8MQPcpOWweZrOmlqws5Aw/6euPFCsJZ3LZ/dXqxpLPy9RyMEOCT9x38v+v8dOmg2oclw=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:19:36.137113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-089cf733-5461-4cba-ad21-03e9203bd9bb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Getting quotas for project 89d0e9ff07ea4aaea9087d1558cade5f. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:19:36.141785 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-089cf733-5461-4cba-ad21-03e9203bd9bb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Getting quotas for user b2af8118d23a4eb184ff229ac0583e45 and project 89d0e9ff07ea4aaea9087d1558cade5f. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:19:36.171811 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-089cf733-5461-4cba-ad21-03e9203bd9bb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.252429 Aug 31 04:19:36.172640 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 518/1028] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 31 04:19:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:19:52.486429 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 04:19:52.486974 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Wed Aug 31 04:19:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Aug 31 04:19:52.487523 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=33 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:19:52.488256 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:19:52.494623 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-588072818", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1964917460", "security_groups": [{"name": "tempest-secgroup-smoke-706475048"}], "networks": [{"uuid": "426da267-4f22-42e2-807b-d5e499ca79fe"}], "block_device_mapping_v2": [{"uuid": "22b18e0a-8634-4c6a-b16d-136dd79e4a22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:19:52.622714 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.network.neutron [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] validate_networks() for [('426da267-4f22-42e2-807b-d5e499ca79fe', None, None, None, None, None)] {{(pid=120661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 04:19:53.123796 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Flavor limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 04:19:53.124210 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Image limits 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 04:19:53.124675 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Flavor pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 04:19:53.125072 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Image pref 0:0:0 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 04:19:53.125477 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.virt.hardware [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 04:19:53.135410 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:53.135881 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:53.136306 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:53.137022 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:53.137462 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:53.137879 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:53.156011 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Getting quotas for project 89d0e9ff07ea4aaea9087d1558cade5f. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 04:19:53.160122 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.quota [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Getting quotas for user b2af8118d23a4eb184ff229ac0583e45 and project 89d0e9ff07ea4aaea9087d1558cade5f. Resources: {'cores', 'ram', 'instances'} {{(pid=120661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 04:19:53.222443 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Going to run 1 instances... {{(pid=120661) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 04:19:53.226103 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22b18e0a-8634-4c6a-b16d-136dd79e4a22',volume_size=None,volume_type=None)] {{(pid=120661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 04:19:53.378170 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3c9386dd-4172-45e4-aae4-74413abb4f3d tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.894061 Aug 31 04:19:53.378752 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 511/1029] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 31 04:19:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 04:19:53.392047 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:19:53.392858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:19:53.398628 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-84357f75-e45a-4de0-b840-07205175813c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:19:53.399927 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-84357f75-e45a-4de0-b840-07205175813c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:19:53.456674 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-84357f75-e45a-4de0-b840-07205175813c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:19:53.464902 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-84357f75-e45a-4de0-b840-07205175813c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1088 microversion: 2.1 time: 0.075228 Aug 31 04:19:53.465490 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 519/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:19:53 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:19:54.486891 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:19:54.487854 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:19:54.495812 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:54.496736 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:54.496874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:54.497559 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:54.498018 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:54.498446 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:54.578201 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:19:54.587205 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-97f6d8a3-0c06-424a-8f1b-2b85a5ea5826 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1194 microversion: 2.1 time: 0.105130 Aug 31 04:19:54.588120 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 512/1031] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:19:54 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:19:55.610500 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:19:55.623866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:19:55.623866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:55.623866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:55.623866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:55.625483 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:55.625483 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:55.625483 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:55.848776 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:19:55.857350 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1b0a418f-a778-4bde-b5bb-a951c76f3732 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.250990 Aug 31 04:19:55.857940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 520/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:19:55 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:19:55.948764 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-255350be-0efe-44f4-abeb-abfac6553390 req-2ce401aa-ea6b-4b90-8d1c-9ddbccfac5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74e920a-b980-4a3c-b5b1-ffc60c29d6c5", "tag": "448c947f-c084-4404-825d-ce8258759bf2"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:19:55.960378 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-255350be-0efe-44f4-abeb-abfac6553390 req-2ce401aa-ea6b-4b90-8d1c-9ddbccfac5ef service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:55.960936 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-255350be-0efe-44f4-abeb-abfac6553390 req-2ce401aa-ea6b-4b90-8d1c-9ddbccfac5ef service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:55.961428 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-255350be-0efe-44f4-abeb-abfac6553390 req-2ce401aa-ea6b-4b90-8d1c-9ddbccfac5ef service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:55.977067 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-255350be-0efe-44f4-abeb-abfac6553390 req-2ce401aa-ea6b-4b90-8d1c-9ddbccfac5ef service nova] Creating event network-changed:448c947f-c084-4404-825d-ce8258759bf2 for instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 on hv-cinder-85391 Aug 31 04:19:55.982712 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-255350be-0efe-44f4-abeb-abfac6553390 req-2ce401aa-ea6b-4b90-8d1c-9ddbccfac5ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037816 Aug 31 04:19:55.983469 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 513/1033] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:19:56.881549 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:19:56.882124 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:19:56.889287 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:56.889770 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:56.890228 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:56.890922 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:56.891429 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:56.891900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:57.103869 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:19:57.112803 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1f6e0be6-2f84-4d1d-88c9-4230e844fe0a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.236268 Aug 31 04:19:57.113513 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 521/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:19:56 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:19:58.136171 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:19:58.136971 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:19:58.143617 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:58.144107 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:58.144544 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:58.145275 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:58.145704 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:58.146095 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:58.292242 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:19:58.300098 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-783d4b81-79a0-4c97-b158-3fdf8415b1fb tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.169673 Aug 31 04:19:58.300668 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 514/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:19:58 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:19:59.321529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:19:59.322152 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:19:59.329342 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:59.329824 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:59.330252 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:59.330941 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:19:59.331440 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:19:59.331835 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:19:59.470592 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:19:59.482813 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3f92f70e-605b-4dd4-83f8-adc040132d88 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.165008 Aug 31 04:19:59.483852 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 522/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:19:59 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:00.511247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:00.511843 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:00.518607 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:00.519116 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:00.519549 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:00.520229 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:00.520672 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:00.521083 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:00.665273 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:00.673406 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-3730a1a4-af4a-412e-a132-2adf0c905bf8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.167601 Aug 31 04:20:00.673975 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 515/1037] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:00 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:01.694464 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:01.695146 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:01.702617 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:01.703163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:01.703648 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:01.704373 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:01.704850 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:01.705295 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:01.853026 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:01.861907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3f891eef-0fbc-461e-a50a-e4d83cf37300 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.171650 Aug 31 04:20:01.862480 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 523/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:01 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:02.882076 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:02.882718 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:02.889606 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:02.890090 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:02.890514 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:02.891240 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:02.891686 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:02.892100 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:03.023811 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:03.031940 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ebdcbfa5-7ee9-415e-af5e-697af5d75976 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.153805 Aug 31 04:20:03.032514 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 516/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:02 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:04.057029 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:04.057948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:04.062552 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:20:04.071841 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:04.072635 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:04.073355 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:04.074487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:04.075290 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:04.075987 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:04.226122 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:04.235315 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f20b3eb6-bcd3-42b4-b501-f9bd16be9978 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.184953 Aug 31 04:20:04.235866 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 524/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:04 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:05.260680 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:05.261605 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:05.264764 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=2 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:20:05.266000 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell0:SELECT=6 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:20:05.276951 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:05.277733 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:05.278437 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:05.279573 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:05.280347 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:05.281534 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:05.423518 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:05.431630 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-9061eb18-f92f-42de-88ba-50cac965a77a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.177644 Aug 31 04:20:05.432211 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 517/1041] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:05 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:06.463883 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:06.464820 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:06.477018 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:06.478132 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:06.478869 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:06.480257 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:06.481380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:06.482080 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:06.622744 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:06.630790 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-12588bcd-d997-4674-bb17-580f3beb3bee tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.173480 Aug 31 04:20:06.631638 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 525/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:06 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:06.715001 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-b136a312-e9c5-411e-befb-6661dd44288a req-803cd70a-bbd7-47aa-990a-e540c62281ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74e920a-b980-4a3c-b5b1-ffc60c29d6c5", "name": "network-vif-plugged", "status": "completed", "tag": "448c947f-c084-4404-825d-ce8258759bf2"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:20:06.724848 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b136a312-e9c5-411e-befb-6661dd44288a req-803cd70a-bbd7-47aa-990a-e540c62281ed service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:06.725363 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b136a312-e9c5-411e-befb-6661dd44288a req-803cd70a-bbd7-47aa-990a-e540c62281ed service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:06.725755 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b136a312-e9c5-411e-befb-6661dd44288a req-803cd70a-bbd7-47aa-990a-e540c62281ed service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:06.737129 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-b136a312-e9c5-411e-befb-6661dd44288a req-803cd70a-bbd7-47aa-990a-e540c62281ed service nova] Creating event network-vif-plugged:448c947f-c084-4404-825d-ce8258759bf2 for instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 on hv-cinder-85391 Aug 31 04:20:06.742142 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-b136a312-e9c5-411e-befb-6661dd44288a req-803cd70a-bbd7-47aa-990a-e540c62281ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094421 Aug 31 04:20:06.742896 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 518/1043] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:20:07.656449 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:07.657405 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:07.668200 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:07.668993 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:07.669710 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:07.670806 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:07.671590 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:07.672393 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:07.812118 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:07.821569 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ebd12d56-a58b-4b52-b8f8-887935ad61e0 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1259 microversion: 2.1 time: 0.171963 Aug 31 04:20:07.822165 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 526/1044] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:07 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:08.846560 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:08.847404 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:08.856007 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:08.856708 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:08.857220 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:08.858028 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:08.858555 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:08.859065 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:08.999670 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:09.008285 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-2ab33589-2c3a-4e43-a563-dbfdacd6f891 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1442 microversion: 2.1 time: 0.168194 Aug 31 04:20:09.008826 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 519/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:08 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:09.028400 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:20:09.029044 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:20:09.035922 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:09.036406 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:09.036845 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:09.037532 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:09.037967 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:09.038384 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:09.181375 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:20:09.194113 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d3126ebd-4aa1-4b2a-9c96-1e593cb820df tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1442 microversion: 2.1 time: 0.169369 Aug 31 04:20:09.194922 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 527/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:20:09 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1442 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:20:11.220114 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [req-b7c395d6-85d8-4bb2-a7bd-052cd62de426 req-f11e545e-7549-47cc-881d-e8a444995b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74e920a-b980-4a3c-b5b1-ffc60c29d6c5", "tag": "448c947f-c084-4404-825d-ce8258759bf2"}]} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:20:11.229961 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b7c395d6-85d8-4bb2-a7bd-052cd62de426 req-f11e545e-7549-47cc-881d-e8a444995b72 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:20:11.230451 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b7c395d6-85d8-4bb2-a7bd-052cd62de426 req-f11e545e-7549-47cc-881d-e8a444995b72 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:20:11.231247 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [req-b7c395d6-85d8-4bb2-a7bd-052cd62de426 req-f11e545e-7549-47cc-881d-e8a444995b72 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:20:11.244594 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.compute.server_external_events [req-b7c395d6-85d8-4bb2-a7bd-052cd62de426 req-f11e545e-7549-47cc-881d-e8a444995b72 service nova] Creating event network-changed:448c947f-c084-4404-825d-ce8258759bf2 for instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 on hv-cinder-85391 Aug 31 04:20:11.249482 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [req-b7c395d6-85d8-4bb2-a7bd-052cd62de426 req-f11e545e-7549-47cc-881d-e8a444995b72 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033229 Aug 31 04:20:11.250068 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 520/1047] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:22:05.339806 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=20 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:22:05.341005 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=48 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:22:05.342509 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:22:05.342779 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Wed Aug 31 04:22:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5/action (ip 10.222.0.18) !!! Aug 31 04:22:05.353369 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:22:05.354226 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:05.365833 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:05.366422 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:05.366951 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:05.367973 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:05.368616 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:05.369192 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:05.399908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lazy-loading 'flavor' on Instance uuid c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 04:22:05.518160 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-43291112-d28e-4801-925c-7dc1696e1090 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "POST /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5/action" status: 202 len: 0 microversion: 2.1 time: 0.181223 Aug 31 04:22:05.518761 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 528/1048] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:22:05 2022] POST /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:22:05.526270 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de9d6755-2172-462a-a77b-bde6869eec3d] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 04:22:05.526874 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:22:05.527669 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=44 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:22:05.528478 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 04:22:05.528613 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: Wed Aug 31 04:22:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 (ip 10.222.0.18) !!! Aug 31 04:22:05.535877 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:05.536595 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:05.549476 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:05.549884 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:05.550321 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:05.551013 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:05.551485 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:05.551908 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:05.765653 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:05.777963 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-01dcbd7c-52e1-4ed6-b3b0-1b9671da562c tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.253872 Aug 31 04:22:05.778876 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 521/1049] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:05 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:06.805628 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:06.806773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:06.819546 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:06.820339 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:06.821061 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:06.822201 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:06.822955 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:06.823708 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:07.014487 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:07.022314 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-921970f0-3ebf-473f-81a8-09fc24b5dfe8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.223885 Aug 31 04:22:07.022890 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 529/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:06 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:08.050436 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:08.051368 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:08.065470 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:08.066259 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:08.066966 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:08.068132 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:08.068871 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:08.069557 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:08.079035 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO oslo.messaging._drivers.impl_rabbit [-] [de9d6755-2172-462a-a77b-bde6869eec3d] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39798. Aug 31 04:22:08.209652 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:08.217510 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e4739c97-6753-4608-9135-3e7901e704f9 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.173838 Aug 31 04:22:08.218081 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 522/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:08 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:09.242843 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:09.243852 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:09.253105 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:09.253587 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:09.254013 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:09.254687 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:09.255163 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:09.255576 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:09.397931 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:09.409156 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cf88b736-5bb1-40a7-b78f-f312e69aea65 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.172769 Aug 31 04:22:09.409751 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 530/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:09 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:10.435508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:10.436430 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:10.447662 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:10.448455 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:10.449169 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:10.450297 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:10.451082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:10.451772 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:10.592501 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:10.605416 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-ca79c4d1-d06c-45ff-973b-b84e0b9df107 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.176430 Aug 31 04:22:10.606258 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 523/1053] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:10 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:11.633450 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:11.634341 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:11.646104 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:11.646910 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:11.647675 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:11.648815 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:11.649529 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:11.650281 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:11.785654 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:11.793573 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-38093e54-8c61-4794-9d71-3d9e5c626fd1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.167869 Aug 31 04:22:11.794162 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 531/1054] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:11 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:12.818962 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:12.819965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:12.830876 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:12.831388 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:12.831819 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:12.832508 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:12.832955 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:12.833371 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:12.977319 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:12.989120 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-714352c0-7780-4b08-acf4-43f03240d123 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.176430 Aug 31 04:22:12.989948 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 524/1055] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:12 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:14.016012 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:14.016654 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:14.023907 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:14.024388 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:14.024799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:14.025484 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:14.025925 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:14.026339 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:14.165411 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:14.174015 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f812d408-1ba1-4103-be30-f19db3b8a285 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.162724 Aug 31 04:22:14.174816 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 532/1056] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:14 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:15.199074 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:15.200082 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:15.211094 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:15.211929 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:15.212653 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:15.213793 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:15.214551 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:15.215322 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:15.360487 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:15.373741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-e6960476-3e9e-49dc-beb7-6bfc6f7cda6a tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.180924 Aug 31 04:22:15.374497 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 525/1057] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:15 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:16.399214 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:16.399805 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:16.406804 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:16.407660 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:16.408210 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:16.408930 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:16.409385 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:16.409977 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:16.576584 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:16.589332 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-576bb633-6cee-4090-a00b-1c3c43d1c117 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.194041 Aug 31 04:22:16.590265 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 533/1058] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:16 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:17.618903 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:17.619855 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:17.630765 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:17.631309 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:17.631741 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:17.632436 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:17.632889 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:17.633311 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:17.785224 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:17.792834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-8897f0c5-5235-457a-ae90-128cbdfa7042 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1567 microversion: 2.1 time: 0.181175 Aug 31 04:22:17.793399 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 526/1059] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:17 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:18.817668 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:18.818511 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:18.826015 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:18.826498 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:18.826922 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:18.827647 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:18.828091 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:18.828501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:18.968472 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:18.976858 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ed77ab95-0a19-4bc2-b6cd-661a42bcad60 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1508 microversion: 2.1 time: 0.164466 Aug 31 04:22:18.977437 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 534/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:18 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:18.997543 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:22:18.998118 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:19.005018 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:19.005485 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:19.005909 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:19.006664 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:19.007200 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:19.007617 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:19.037934 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120661) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 04:22:19.108919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7886e320-e517-498e-ac65-7e2fa2cacc8f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "POST /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5/action" status: 202 len: 0 microversion: 2.1 time: 0.115171 Aug 31 04:22:19.109447 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 527/1061] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 31 04:22:18 2022] POST /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 04:22:19.117982 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:19.118668 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:19.125301 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:19.125769 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:19.126192 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:19.126900 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:19.127371 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:19.127773 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:19.299661 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:19.308398 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2000c281-cda0-43a9-9486-5dbfae71a4ba tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1516 microversion: 2.1 time: 0.194528 Aug 31 04:22:19.309071 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 535/1062] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:19 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:20.330904 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:20.331584 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:20.339321 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:20.339707 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:20.340142 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:20.340838 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:20.341293 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:20.341713 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:20.478663 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:20.490966 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-d5b2c115-e6fe-445e-b3b2-e30037fc374b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1574 microversion: 2.1 time: 0.164650 Aug 31 04:22:20.491919 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 528/1063] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:20 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:21.109136 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-c42e09e0-3852-4916-b913-4067fae36e8e req-661e78c1-7b0b-4fe3-ab94-59657078bca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74e920a-b980-4a3c-b5b1-ffc60c29d6c5", "name": "network-vif-unplugged", "status": "completed", "tag": "448c947f-c084-4404-825d-ce8258759bf2"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:22:21.122066 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c42e09e0-3852-4916-b913-4067fae36e8e req-661e78c1-7b0b-4fe3-ab94-59657078bca9 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:21.122561 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c42e09e0-3852-4916-b913-4067fae36e8e req-661e78c1-7b0b-4fe3-ab94-59657078bca9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:21.122977 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c42e09e0-3852-4916-b913-4067fae36e8e req-661e78c1-7b0b-4fe3-ab94-59657078bca9 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:21.135784 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-c42e09e0-3852-4916-b913-4067fae36e8e req-661e78c1-7b0b-4fe3-ab94-59657078bca9 service nova] Creating event network-vif-unplugged:448c947f-c084-4404-825d-ce8258759bf2 for instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 on hv-cinder-85391 Aug 31 04:22:21.140987 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-c42e09e0-3852-4916-b913-4067fae36e8e req-661e78c1-7b0b-4fe3-ab94-59657078bca9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036540 Aug 31 04:22:21.142704 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 536/1064] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:22:21.517203 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:21.518121 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:21.526757 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:21.527269 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:21.527696 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:21.528379 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:21.528824 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:21.529241 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:21.659783 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:21.667913 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-dc3ad1f7-e792-4e03-a571-9ed399c5fc72 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1574 microversion: 2.1 time: 0.157940 Aug 31 04:22:21.668486 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 529/1065] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:21 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:22.695463 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:22.696156 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:22.702834 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:22.703345 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:22.703778 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:22.704465 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:22.704908 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:22.705322 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:22.848770 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:22.862356 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-73d08e9e-da6d-450b-bcb1-233a8c122136 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1574 microversion: 2.1 time: 0.174104 Aug 31 04:22:22.863174 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 537/1066] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:22 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:23.888270 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:23.889296 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:23.899258 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:23.899758 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:23.900187 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:23.900883 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:23.901336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:23.901782 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:24.046930 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:24.055045 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-29dcca02-43a8-466f-9886-005ed40f4fcd tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1574 microversion: 2.1 time: 0.173400 Aug 31 04:22:24.055629 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 530/1067] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:23 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:25.081267 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:25.082225 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:25.090501 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:25.090979 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:25.091432 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:25.092111 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:25.092557 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:25.092970 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:25.244195 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:25.256799 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-08643974-dbc7-4479-a3bb-87e66c24d197 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1574 microversion: 2.1 time: 0.181846 Aug 31 04:22:25.257950 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 538/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:25 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:26.282228 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:26.282810 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:26.289637 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:26.290414 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:26.290584 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:26.291317 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:26.291751 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:26.292172 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:26.444831 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:26.453409 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-5f1da163-3c39-403d-816d-399dbbdeb3ab tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1574 microversion: 2.1 time: 0.175195 Aug 31 04:22:26.453965 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 531/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:26 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:27.479255 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:27.479874 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:27.487360 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:27.487870 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:27.488319 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:27.489037 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:27.489503 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:27.489940 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:27.630052 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:27.638119 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a5c564d4-b478-41b2-8dca-c59054d91b5b tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1574 microversion: 2.1 time: 0.165403 Aug 31 04:22:27.638663 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 539/1070] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:27 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:28.663704 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:22:28.664638 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:22:28.676304 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:28.677112 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:28.677834 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:28.678979 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:28.679787 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:28.680493 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:28.823189 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:22:28.831830 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-11efabd9-a0ee-41a4-8353-6fbb94f7cf86 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1561 microversion: 2.1 time: 0.174820 Aug 31 04:22:28.832449 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 532/1071] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:22:28 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:22:31.240684 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-1628e6b6-d4fb-4435-a60a-ee7efe3d4520 req-608839ee-604c-484d-8444-b7547fa340ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74e920a-b980-4a3c-b5b1-ffc60c29d6c5", "name": "network-vif-plugged", "status": "completed", "tag": "448c947f-c084-4404-825d-ce8258759bf2"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:22:31.253678 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1628e6b6-d4fb-4435-a60a-ee7efe3d4520 req-608839ee-604c-484d-8444-b7547fa340ed service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:22:31.254669 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1628e6b6-d4fb-4435-a60a-ee7efe3d4520 req-608839ee-604c-484d-8444-b7547fa340ed service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:22:31.255138 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-1628e6b6-d4fb-4435-a60a-ee7efe3d4520 req-608839ee-604c-484d-8444-b7547fa340ed service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:22:31.269830 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-1628e6b6-d4fb-4435-a60a-ee7efe3d4520 req-608839ee-604c-484d-8444-b7547fa340ed service nova] Creating event network-vif-plugged:448c947f-c084-4404-825d-ce8258759bf2 for instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 on hv-cinder-85391 Aug 31 04:22:31.275587 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-1628e6b6-d4fb-4435-a60a-ee7efe3d4520 req-608839ee-604c-484d-8444-b7547fa340ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038703 Aug 31 04:22:31.277064 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 540/1072] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:23:39.885520 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:39.886869 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG dbcounter [-] [120661] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:39.887752 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=26 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:39.888763 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:39.891245 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:23:39.891973 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:23:39.902408 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:39.902861 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:39.903702 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:39.904466 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:39.904895 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:39.905949 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:39.933849 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Going to try to terminate instance {{(pid=120661) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 04:23:39.960724 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-4df51e35-2179-42b5-9f94-dac710253fe9 req-609b7ebf-2424-4b03-b8c2-de7ddab1c7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74e920a-b980-4a3c-b5b1-ffc60c29d6c5", "tag": "448c947f-c084-4404-825d-ce8258759bf2"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:23:39.971918 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4df51e35-2179-42b5-9f94-dac710253fe9 req-609b7ebf-2424-4b03-b8c2-de7ddab1c7d2 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:39.972180 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4df51e35-2179-42b5-9f94-dac710253fe9 req-609b7ebf-2424-4b03-b8c2-de7ddab1c7d2 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:39.972667 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4df51e35-2179-42b5-9f94-dac710253fe9 req-609b7ebf-2424-4b03-b8c2-de7ddab1c7d2 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:39.984975 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-4df51e35-2179-42b5-9f94-dac710253fe9 req-609b7ebf-2424-4b03-b8c2-de7ddab1c7d2 service nova] Creating event network-changed:448c947f-c084-4404-825d-ce8258759bf2 for instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 on hv-cinder-85391 Aug 31 04:23:39.993380 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-4df51e35-2179-42b5-9f94-dac710253fe9 req-609b7ebf-2424-4b03-b8c2-de7ddab1c7d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107705 Aug 31 04:23:39.994238 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 541/1073] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:23:40.008571 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: ERROR oslo.messaging._drivers.impl_rabbit [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [e9b3c0ce-af27-4e37-b9b2-4ef5c03e7d59] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 04:23:41.016174 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO oslo.messaging._drivers.impl_rabbit [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [e9b3c0ce-af27-4e37-b9b2-4ef5c03e7d59] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39886. Aug 31 04:23:41.039732 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-67766a86-afdb-46a9-aeca-e3d439481f93 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 204 len: 0 microversion: 2.1 time: 1.156222 Aug 31 04:23:41.040336 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 533/1074] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 31 04:23:39 2022] DELETE /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 0 bytes in 1158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 04:23:41.050027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:23:41.050733 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:23:41.057208 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:41.057718 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:41.058150 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:41.058827 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:41.059308 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:41.059725 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:41.195013 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:23:41.203689 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-56a59259-d642-4b6a-b626-6ea09227628f tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1448 microversion: 2.1 time: 0.158558 Aug 31 04:23:41.211871 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 542/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:23:41 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:23:42.235006 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:23:42.235794 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:23:42.243231 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:42.243720 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:42.244151 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:42.244827 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:42.245274 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:42.245691 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:42.386221 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:23:42.394691 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-7b029a9c-4e6c-4f0f-b4ed-c13ac95e9b3e tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1448 microversion: 2.1 time: 0.166378 Aug 31 04:23:42.395328 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 534/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:23:42 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:23:43.058948 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-fdb233db-adfa-48f3-84b2-3d903e2eff0d req-be82b68b-64cf-4a14-be5e-b7fc6f6e2450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74e920a-b980-4a3c-b5b1-ffc60c29d6c5", "name": "network-vif-deleted", "tag": "448c947f-c084-4404-825d-ce8258759bf2"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 04:23:43.070064 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fdb233db-adfa-48f3-84b2-3d903e2eff0d req-be82b68b-64cf-4a14-be5e-b7fc6f6e2450 service nova] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:43.070526 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fdb233db-adfa-48f3-84b2-3d903e2eff0d req-be82b68b-64cf-4a14-be5e-b7fc6f6e2450 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:43.071083 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fdb233db-adfa-48f3-84b2-3d903e2eff0d req-be82b68b-64cf-4a14-be5e-b7fc6f6e2450 service nova] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:43.082949 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-fdb233db-adfa-48f3-84b2-3d903e2eff0d req-be82b68b-64cf-4a14-be5e-b7fc6f6e2450 service nova] Creating event network-vif-deleted:448c947f-c084-4404-825d-ce8258759bf2 for instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 on hv-cinder-85391 Aug 31 04:23:43.088151 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-fdb233db-adfa-48f3-84b2-3d903e2eff0d req-be82b68b-64cf-4a14-be5e-b7fc6f6e2450 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091473 Aug 31 04:23:43.088992 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 543/1077] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 31 04:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 04:23:43.416738 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:23:43.417435 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.compute.api [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120661) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:23:43.424506 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:43.424994 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:43.425423 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:43.426114 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:43.427797 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:43.428460 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG oslo_concurrency.lockutils [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:43.509625 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.policy [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af8118d23a4eb184ff229ac0583e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d0e9ff07ea4aaea9087d1558cade5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 04:23:43.518002 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-85c462d7-ef75-4fb9-9e91-52c8aa999de1 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 200 len: 1219 microversion: 2.1 time: 0.105619 Aug 31 04:23:43.518563 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 535/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:23:43 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 04:23:44.543876 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:23:44.545298 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] [instance: c74e920a-b980-4a3c-b5b1-ffc60c29d6c5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 04:23:44.553014 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:44.553499 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:44.553939 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:44.554641 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Acquiring lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 04:23:44.555095 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 04:23:44.555673 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Lock "8a3d84ca-31a2-4935-a9cc-c227c7d3bb0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 04:23:44.569098 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] HTTP exception thrown: Instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 could not be found. Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Request method failure captured: Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 HTTP/1.1 Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept: application/json Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Connection: close Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Length: 0 Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Content-Type: application/json Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Host: 10.222.0.18 Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjDuFSwjPj_MQt65-61FdkjjkkH0YE7EgiF8Hn_pOouwK2LaxViFaoG8FvM7XQaGhp9XYqju1R4XIorj6JtBGF3ip5CRQr3gbyn3P65Sdf9QIGULV5U-vvMgLth-kZrDwmytn4L0FZQezlMRSX3650MHu3a_WQuPxtdzhpD6nq6OLHm6o Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Id: 89d0e9ff07ea4aaea9087d1558cade5f Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestShelveInstance-1989253607 Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Role: reader,member Aug 31 04:23:44.570737 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Roles: reader,member Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89d0e9ff07ea4aaea9087d1558cade5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89d0e9ff07ea4aaea9087d1558cade5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89d0e9ff07ea4aaea9087d1558cade5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89d0e9ff07ea4aaea9087d1558cade5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestShelveInstance-1989253607 Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 89d0e9ff07ea4aaea9087d1558cade5f Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestShelveInstance-1989253607 Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User: tempest-TestShelveInstance-1989253607-project Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Id: b2af8118d23a4eb184ff229ac0583e45 Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestShelveInstance-1989253607-project Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: method: > Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: exception: Instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 could not be found. Aug 31 04:23:44.572727 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: action_args: {'id': 'c74e920a-b980-4a3c-b5b1-ffc60c29d6c5'} Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 could not be found. Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 04:23:44.573958 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 could not be found. Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 could not be found. Aug 31 04:23:44.575846 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Aug 31 04:23:44.578027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Returning 404 to user: Instance c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 04:23:44.578027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0adc951d-578a-402a-b52e-46524bb5b6e8 tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5" status: 404 len: 111 microversion: 2.1 time: 0.035567 Aug 31 04:23:44.578027 dv-cinder-853910-5-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 544/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 31 04:23:44 2022] GET /compute/v2.1/servers/c74e920a-b980-4a3c-b5b1-ffc60c29d6c5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 04:23:44.748840 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: DEBUG nova.api.openstack.wsgi [None req-55702e2e-6359-4d61-82fb-8c5f36fbe0ec tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] Calling method '.version_select at 0x7f88ad2cbee0>' {{(pid=120661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 04:23:44.780832 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: INFO nova.api.openstack.requestlog [None req-55702e2e-6359-4d61-82fb-8c5f36fbe0ec tempest-TestShelveInstance-1989253607 tempest-TestShelveInstance-1989253607-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1964917460" status: 202 len: 0 microversion: 2.1 time: 0.035877 Aug 31 04:23:44.781772 dv-cinder-853910-5-iscsi devstack@n-api.service[120661]: [pid: 120661|app: 0|req: 536/1080] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Aug 31 04:23:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1964917460 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)